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ABSTRACT 

Observations by trained observers using the 
Descriptive Observation Record of Individualized Instruction were 
compiled on 335 teachers, who also completed a self-report of the 
Individualization of Instruction Inventory. Both inventory results 
were then examined with the ^purpose of determining the relationship 
between self-reports of the teachers and reports made by the trained 
observers, vith this relationship haviny implications for inservice 
programs. The teachers' ^roup was composed of 200 . academic, 86 
vocational, and U9 special education teachers from 20 school 
districts. located near Austin, Texas. Major findings showed that (1) 
teachers' self* reports /yielded higher scores than observer recorded 
scores; (2) discrepanc:jLes between scores derived from teachers' 
self-reports and libserver-reported scores increased as the degree of 
individualization of instruction, reflected from observations, 
decreased; (3) scores derived from teachers* self-reports varied in a 
systematic way from observer- repp rted scores, which permitted the 
conversion of teacher sei\f -report s into scores that were reasonable 
predictors of observer reported scores; (U) teachers who were 
•observed to be individualizing instruction more tended to have more 
realistic perceptions than did teachers who, were observed' to be 
individualizing instruction less, and (5) teachers who were from 
districts which had of fered inservice education in individualization 
in instruction seemed more enthusiastic as evidenced by invitations 
to view materials and student work. (TA) 
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CHAPTER I 



INTRODUCTION 



Statement of the Problem , 

As categorical funding for education undergoes 
close scrutiny by funding sources, the need for accounta- 
bility in education becomes more evident. Evaluative data 
are essential to accountability and are dependent upon 
reliable information. ' . " 

Information as to the degree of individualiza- 
tion of instruction is one type of evaluative data which 
has been used in a systems analysis approach to accounta- ' 
bility in educational organizations (Harris, 1971). The 
Individualization of Instruction Inventory developed by 
Harris and Co.ody (1971) has been established as an accept- 
able instrument for use by trained observers in describ- 
ing five aspects of individualization of instruction. 
Harris, Bessent, and Mclntyre (1969) emphasize the point 
that reliability increases with- mu Itiple observations. 
While such reliability is desirable and may be '/ su f f ic iently, 
cost-effective for use in a local setting, the'cost wo.uld 
be prohibitive in statewide evaluative efforts. A Teacher 



2 

Questionnaire (TQ) form of the Individualization ox" In- 
struction Inventory has been utilized in conjunction with 
observations. Positive relationships between self-report 
and observer-completed versions of the Individualization 
of Instruction Inventory were predicted by Harris, but no 
systematic method had yet been developed to predict ob- 
served levels of Individualization of instruction base6 • 
on teachers' se If -reports . 

Pur-poses of the Study ' . 

The purposes of this study were: 

1. to submit to systematic inquiry the self -reported 
estimates of individualization of instruction as 

compared , with observations of the same teachers 

/ ! - 

'by trained observers. / 

2. to develop a set of. factors, for converting self- 

/ . 

reports of individualization of instruction ob- 
tained from. the Teacher Questionnaire of the In- 
dividualization of Instruction Inventory into 
scores which would be reasonable predictions of 

1 

scores recorded by trained observers. 
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Such a set of conversion factors would then per- 
mit administrators of the Teacher Questionnaire of the 
Individualization of /Instruction Inventory to provide data 
from large numbers of vocational, academic, and snecial 
education teachers for use in decision making by educa- 
tional planners at the regional, state, or national level. 

Assumptions ^ 

/ 

^ ,Two assumptions provided the basis for the pro- 

posed' study. The first of these assumptions was that the^ 
teaching process can be submitted to systematic inquiry. 
Classroom/ teaching involves human beings in group situa- 
tions. Observation techniques can be applied to tii£,.^cj^ss^ 

room teaching process. 

The second of these assumptions was that teach- 
ing involves behaviors which can be identified, and which 
teachers can systematically acquire. These behaviors 
should be regarded as skills which can be acquired through 
the study and analysis of teaching. Skills can be prac- 
ticed and controlled in and out of the classroom. 

Limi tat i ons 

This study was' subject to the usual constraints 
which confront researchers in their attempts to publish 



findings of significant impact on the educational community 
namely^ time, reso.urces, and geography. 

Although predictive model development was desired 
it was anticipated that, in the strictest sense, it would 
^only predict scores of , individual teachers utilized in 
the sample considered in this study. Any generalizations 
made from information contained in this paper are done on 
the usejr's cognizance. . 

While reliability of data increases as the num- 
ber of observations by trained observers increases, prac- 
tical considerations limited this study to one observation 
and one self-report per teacher. 

\ 

\ 

Theoretical Framework 

The Texas Education Agency is the state agency 
charged by the Texas Legislature^^ to direct^ and evaluate 
the nature and effects of public: elementary and secondary 
education in Texas. A recent review of the Texas Educa- 
tion Code surfaced the following specific mandates from 
the Legislature to the Agency: 

exercise "general control of the system of public 
education at ; the state level/* Sec. 11.02(a) 

\ 11 

• \ ■ 



serve . as "the policy-forming and planning body for 
the public school system for the state" Sec, 11.24(a) 

review "periodically the educational needs of the 
state," for adopting or promoting, "plans for meet- 
ing those needs," and for evaluating, "the achieve- 
ments of the educational program" Sec. il^6(?i) 

accept responsibility for "promoting efficiency and 
improvement in the public school system of the state. 
Sec. 11.52(b) 



Thus, the Agency is accountable to the Texas Legislature 
and to the people of Texas for the wise investment of the 

puiblic resources to produce educational benefits for Texas 

.... ' ■ ' . 

citizens. 

In carrying out these functions of setting di- 
rections for elementary and secondary education, assessing 
needs, and evaluating progress, the State Board of Educa- 
tion adopted in October, 1971, a set of Goals for Public 
School Education in Texas . Part I of the statement deals 
specifically with the outcomes for learners which the 
State Board desires to" be achieved. Part II refers tp 
"Organizational Efficiency," that is, to' desired improve-^ 
ments in school programs and services which will increase 
learner benefits. Part...III centers upon, strengthening the 
capability of the sy'stem (the Agency, local districts, 
regional- education service oj&nters^ etc.) to plan system- 

X 

atically and to be accountable for results produced. 



42 , 

/ ^ 



In the State Board's Goals for Public School • 
Education in Texas , Part II pre c r ibe s . "A program of con- 
tinuing evaluation should -d for measuring the 
performance of the public . tem in terms of the 
competency of its products and the efficiency of its struc- 
_tufe and processes." - 
Section 16.310 of the Texas Education Code has 
provided for Texas public school teachers to be compensated 
for ten nonteaching days per year to be used for in-service 
education and preparation for the beginning and'-ending of 
school. This 'law has be'en in effect since 19.70.. 

Vocational, academ^ic, and special education 
teachers have been receiving in-service tra^i,ning in the 
individualization of instruction as part of the ten days 
of in-service training requ irerf, by the State of Texas for 
all teachers. Educational decision maker^ need- to know 
whether this in-service training in the individualization 
of instruction has had an effe;ct upon the: practices of 
these teachers and whether the effect can be measured as 
effectively through self-report as by observation by others 

.■■ : - Harris, Bessent, and Mclntyre ( 1969) have the 
following tV^say aboulf in-service education: 

ft'. 

In summary, we as serted that to put instruc- 

.._.J^J.QJiaL..ch^ 




for achieving that change must be clearly in view. 
• Change may be brought about by use of authority, by. 
-s changes in physical environment (facilities, materi- 
-als, buildings), through use of rules and regulations, 
through changes in functional specialization, and 
■ through in-service development of personnel. Though 
•• it cannot stand alone, in-sei vJ^^- lopment is' the 

most fundamental of the change proc-sses, since/ it 
is concerned directly with._the 1^ ^'vidual, is aimed 
at some, change in his knowledge and behavior ,/ and 
. can affect^ his willingness to accept the change. 

Harris, Bes.sent, and Mdntyre ( 1969) offer the 
following scher/iatic which shows in-service education in 
the total context of change. , 

Individualization of instruction is the element 
to be changed by the in-service programs of concern to 
tthifS study. Individualization of instruction can be 
viewed as a series of strategies to bring about a desired 

re su It . . ■ ■ i 

^ Harris and ^Mdntyre (1971) have broken th^se 

strategies into five classes. These strategies are (1) 
.intraclass Gr.ouping, (2) Variety of 'Materials, (s) Pupil 
Autonomy, (4) Differentiated Assignments, and (5) Tutoijing 

Intraclass grouping can be viewed as. being made 
up of several aspects. These are (l) flexibility ofgroup 
ingS, (2) frequency of changes in grouping, (s) length of 
time students remain in groups, (4) variety of size and 
mber of groups, and (5) freedom of movement. 
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TABLE 1-1 

THE ORGMIZ.'fflONAL COMEXT FOR IN-SERVICE 



u Organization 



OrganizationaJ. 
Maintenance 



'.^Unplanned 
Change 



f 

Organizational ^ 
Change j 



Planned 
Change 



Physical 
Change 



Rule 
Change 



Replacement 



— IT- 

Structural. 
Change 



Funct ional 
Change 



T 



Reassignment. 



Personnels 
Change 
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In-Service 
Education 




A variety of materials would consist of the fol- 
lowing: (1) library books, (2) reference books, (3) teacher 
made materials, (4) newspapers and magazines, and ( 5) audio- 
visual''^ aids . These material,s should have variations in 
levels of difficulty and interest. 

P^^ • T ■ • i^onomy can be measui ' Ly examining 
the folio.. -.^ iteiuo: ( l) pupil self -direction, ( 2) in- 
volvement of pupils in planning, (3) involvement of pupils 
in the leading of activities, (4) self-grading work, ( 5) 
working, with other students, and (6-) uniq.ue learning situa- 
tions. ' 

The substrategies of differentiated a.ssignments 
are (l) interest in assignments, ( 2 ) ' c hall r ■ e and stimula- 
tion of ruTJils, (3) participation of pupi. (4) signifi- 
cant variations in assignments, ( 5) eviden o.f advanced- 
level or --richment work, and (6) basing o:'' ,, signments 
upon specific, diagnosed' learnirig needs. 

Tutoring can be done by -the classroom teachei-, 
special teachers, students, parents, o^ volunteers. 

If the Texas Edu c at ion Agency is to account for,, 

i 

the expenditure of revenuss for in-s^''rv'ice education di- 
rected toitf-aird individu alluring Instrui^tion, cost effective 
measurer ^^e needed for de termining/ the extent to which 
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teachers practice individualization of instruction. As 
mentioned earlier in this paper, "Harris, Bessent, and 
Mclntyre (1969) have pointed out that reliability of ob- 
servations made by trained observers using observation 
guides increases with multiple observations. If the pur- 
pose of observation is to improve practices of an indi- 
vidual teacher, sevt al observations v/ould be highly de- ^ 
sirable. 

- If, oh the other hand, the purpose of observa- 
tion is to provide general information for statewide evalua- 
tion, assess-TT-iC, r: dec is i:: .. making, actual on-site ob- 
servation wc^-l cc- be necessary, if data from teacher 
self-reports rjou"^^d le treated so as ,to yield results wh^jh 
would npt be ^sonable to expect to have -come from 

actual classrocnn observato-on -by trained observers. Stuf- 
flebeam^s (19 71) ir.cdif icat ion of Braybroolce and Lindblom ^ s 
( 1963) diagr-:!! of decision-making settings (Table 1-2) 
illustrates t/nls point. Degree of change is displayed on 
the horizont' exis, with magnitude irrc-Te&s ing, from 'the 
ver^tex.' Sir.u*^ vr:. rising from the verte:: along the verti- 
cal axis is -if-rmati.on grasp, represent :ng increased pre- 
cision in da-a r.c:;^Iection methodologies. State depart- 
-ments of educatl - an^. ^regional education service centers 
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TABLE 1-2 
DECISION-MAKING SETTINGS 



HOMEOSTASIS 

Activity: Restorative/ 

Purpose: Maintenance 

Basis: Technical stan- 
dards and quality 
control 



T 



TNCREMEMALISM 

Activity: Developmental 

Purpose: Continuous Im- 
provement 



Basis: Expert judgment 
plus structured 
inquiry 



METAMQRPHISM 
Activity: Utopian 
Purpose: -Complete Change 
Basis: Overarching theory 



NEQMQBILISM 

Activity: Innovative 

Purpose:. Inventing^ testing, 
and diffusing solu- 
tions to significant 
problems 

Basis: Conceptualizatioa, 
- hieuristic investi- 
gation^ and stmc- 
tured inquiry 



Small 



DEGREE OF CHANGE 



Large 
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traditionally seek continuous improvement of education 

I ■ ■ ■■ 

through developmental activities. These descriptors are.. 

found in the lower left portion of the diagram. There- 
\fore, a decision for a state department of education to 
place a high priority on allocating resources for teachers' 
in-service training in specific aspects of individualiza^ 
tion could be justified through needs-assessment sampling, 
utilizing teacher self-reports of individualization of ' 
instruction. ' . \^ 

Definition of Varl'ables ' • , • 

In order to increase communication between the 

author and the reader, terms for which precise definitions 
/ ' ./■■•. 

/are needed, are presenT:ed in the following alphabetical 

.-I ' '' > • 

listing: 

^ 1. Academic teachers: Thoae .teachers who. devote at 
leasji ohe-half time'" to 'activities classified as 
English (05 series), mathematics (11 series), 
science (15 series), or social studies ( 15 series) 
of the Texe^s Education Agency Assiganfent Code 

.Sheet, TE'A ^37. 
2. Elementary teachers • -Those ' teac.hers in grades 

Kindergarten th-roU'gh---s-l-x— wh-o^-d^ev-i^e^--^ — - 



\ 
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one-half time to activities classified as Ele- 
mentary Education (19 series) of the Texas Educa- 
tion Agency Assignment Code Sheet, TEA 637. 

3. Individualization of instruction: Those strate- 
gies used by teachers to pre , .aitia- 
-cive and self -direction on the part '^of s tuden ts . 
There are five classes of these strategies. These 
classes are (1) intraclass grouping, (2) variety 
of materials, '( 3) pupil autonomy, 4) differen- 
tiated assignments, and (5) tutoring. ■ 

4. ' Special education teachers: Those teachers who 

devotfe at least one-half time ta activities clas^ 
sified as- Spec:ial Education ( 20 . series ) of the 
Texas Education Agenjcy Assignment Code Sheet, 

TEA 637. I . • 

5. Vocational ^teachers :1 Those teachers whose time 

' ' I' • - * ■ 

is reported to the Texas Education Agency on the 

Sec^ondary Vocational Education C las s Or gani za- 
tion Report, VOC-066, R73. 



Research Quest ions 

Research Qu e s tlojis^toj^ 
study were: ' 



1. Teachers' self -reports of individualization , o 
instruction practices on the Individual^ itionVf 
Instruction Inventn- 1 yield higher ^^'ea 
than observations made using the same instrument. 

2. - Discrepancies between scores derived from teachers' 

self-reports of ind i.y idu ali zat i m of instruction 
. practices on the Individualization of Instruction 
Inventory and scores from obsecrations made using 
the same instrument will increase as the degree 
cf individualization of instruction, reflected 
from observations, decreases. 

3. Scores derived from teachers' self-reports of 
individualization of instruction practices will 

.vary in a systematic way from scores derived from 
observations made using the same instrument, so 
as to permit'developmen- of a set of factors for 
converting self -repor.ts of individualization of 
instruction obtained from teacher self-reports 
into, scores which would be reasonable predictors" 

of scores . recorded by trained observers. 

• • ' ' ■ " f , ■ 

Instruments . . ^„ 



This study u,sed the Descriptive Observation 
Record for Individiiiili zat ion of Instruction (Appendix A) 

21 



for each classro. - 'r- '-ion. The ab .ir^trunient wu.j 

developed by Ben M. Harris and Kenneth 31 • Mclntyre and has 
been used in several schools to analyze -instruction. 

The instrument that was 3J^sed for the self-report 
of individualization of instruc tiipn^J^^ the Individual! za- 
tion of Instruction Inventory ( Appendix A). This instru- 
ment was developed by Betty Goody and Ben M. Harris.-^, 

Procedures for Data Collection 
and Analysis 

Letters were sent to superint^endents of school 
districts within 100. miles of Austin inviting pvarticipa- 
tion in the study. Twenty school districts were identi- 
fied from which a sample elementary, academic, vocational 
and special education te.achers were invited by letter to 
participate in the study. At least two vocational and 
special education teachers were '-^chosen from each d is trie t . 

One observation was made in the classrbom of 
each teacher in the sample.-. After observations had been 
completed, each teacher was asked to complete and return 
the self-report form . ^ 

, _,..jUxe.,...aTxs.eJ:.v:a.t.lnn.s^.Mxe.^^ 

observers. An interrater reliability score of .80 was 
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■ req.uj.red by the team of observers during the training ses- 
sions . . " 

The data were punched onto cards to permit their 
analysis through the use of the computer. All analyses 
, were carried out with the statistical copaputer program 
LINEAR developed by Jennings (1971). 

Plan for Remainder of the Study - . 

.y - In' the .following chapter a theoretical frame- 

work for presen.tatipn of hypotheses will be di^scussed. 
The literature was reviewed to identify criteria relevant 
to the hypotheses. 

Chapter III contains a discussion of the pro^ 
cedure used in collecting data. References will he made 
tc data gathering instruments and letters found in the .. 

Appendix. * ■ 

Chapter IV will report the methods used in analyj 
ins the data and the findings of the study. The. final 
chapter will' summarize t^e findings and report conclusions 
drawn as a result of i^the research. A discussion of impli- 
~ cations of this study for further research will conclude 
the report. I 
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CHAPTER II/ 
REVIEW OF LITERATURE 

Much has been written and even more has been 
■ spoken about the need for schools to meet the needs of 

each individual student and to be held accountable for . 
'doing so. The present study includes direct observation 
of individualization of instruction and comparison of 
those observations with teachers' self-reports of indi- . 
vidualization of instruction; thus this review will limit 
its scope to literature which bears most directly on the 

problem. ^' . ' 

Ornstein (1971) pointed out^ that research on 
teacher behavior is not" only voluminous but also contra- ^ 
dictory.^. 

Systematic classrooin observation is\defined in 
the Encyclopedia of Education (Deignton/ 1971:168) as: 

■ / ■ " 

A set of? procedures which uses systems-of. categories 
to code/and quantify classroom behaviors o-f teachers 
and students. These procedures require that observed 
behavl'ors~be' coded or classified by the„use of . non- 
evalultlve, relatively objective sets of categories 
.-,.^r.^,-=.-.^--j^j-fy{f-»^jrg..5^j^]-rt±^ — o-r — a-e-t-lons . 

■ ■ ■ 17 ■ 
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An extensive and. growing list of observati^on instruments 
is available (Simon and Boyer, 1967). 

Early systematic studies on teacher behavior in- 
cluded those by Anderson, Lippitt and White, Withall, Flan- 
ders, Perkins, Cogan, Mitzel and Rabinowitz, and others 
(Amidon and F landers, 1963) . Beginning in the late 1930»s, 
Anderson, and his colleagues systematically observed '^domi- 
native^* or authoritarian and "integrative" or democratic 
behaviors of five teachers over a period of years. They 
demonstrated^ that teacher behavior sets, the climate of the 
class. Lippitt and White conducted laboratory experiments 
to analyze the effects of adult leaders on gr.oups of five 
boys. Their conclusions confirmed and extended the find- 
ings of Anderson. Withallclas sified teachers ' verbal 
statements into seven categories. These categories', formed 
an index of teacher behavior- which related to the Integra- 
tive- domi^native (I/d) ratio of Anderson. Flanders studied 
..the ef fec'ts of integrative and dominative behaviors on in- 
dividual ■ s tu.dents in laboratory situations. ..Favorable re- 
actions were recorded when students were exposed to Integra 
tive behaviors. Perkins used Withall's technique' to demon- 
strate that groups led by integrative leaders were able^ 
to learn more about a given topic, child growth ind develop 
ment, more frequently than groups led by dominative leaders 
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Cogan found that students reported doing more school work 
under teachers who could be classed as integrative. Mitzel 
and Rabinowitz used multiple observations from which they , 
concluded that teachers' behavior patterns vary according ^ 
to the immediate situation. ^ 

' Harris, Bessent, and Mclntyre (1969) discussed' 
three purposes for systematic classroom observation.. Ad", 
ministrative decision making invoi'ves use of. data for such 
purposes as merit pa'y de terminatibns , reprimands, promo- 
tions, and contract renewals. Program evaluatinp; and ^ 
planning focuses on the program rather than the individual.-- 
teacher. Direct in-service ..experience may be gained by 
those being observed as well' as by the obserxers. Pro- 
fessional skill is req.uired for systematic classroom ob- • 
servation. They also pointed out, "Teaching i-s a ve-ry 
complex process. It is not possible for an observer to 
'see everything while observing a classroom." Classroom 
•observation should be for a specific purpose or purposes 
in order for iihe observer to focus on the most relevant _^ 

occurrences. - v 

McGaw, Wardrop, and Brunda ( 19 72) _lisj,e^^^^^ 



sources of error in c las sroom- observation s'bhemes . These 

is 

include! differences beitwee.n observers, imprecise def initio 
of behaviors, and variations in teacher behavior. ^ 
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Kaplan (1964) summarized the status of - sc ientif ic 
observation. "Scientific observation deliberate re- 
search, carried out with care and f or e thou ghty- as con-_^ 
trasted with casual and largely passive perceptions of 
everyday life." • 

Observations Contrasted with Surveys 

In this study, observations, made by trained 
observers, were contrasted with teacher self-reports ob- 
tained through surveying the same individuals who were 
observed. 

According to Hayman ( 1968), the ob'jective of 
descriptive research is to assess and describe certain 
characteristics of a particular situation at one or more 
points in time. Methods equal observation, survey, and 
content analysis. In observation, subjects do not deliber- 
ately furnish information about themselves. In survey, 
subjects help' the researcher to gather data. Hayman rec- 
ommended that the observation form should be limited to 
twenty-five categories. He also cautioned that the order 
of questions may affect Respondents. 

Hillway (1969) cautioned educational research^ 
that surveys help to pin . down facts but cannot reveal what 
conditions are necessarily ideal. . , 
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Both observations and surveys are acceptable 
methods to aTssess and describe characteristics or situa- 
tions. Observations by trained observers have .the advan- 
tage of potentially high, inter-observer reliability. Sur- 
veys have the advantages of low relative cost and lack of 
geographical .cons tr a ints . 

. Teacher Self -Rex>or ting 

Allen and others (l970) made several interesting 
points In the volume entitled Teacher Self Apprais al: A 

Way of Looking over Your Own Shoulder . First/ they pointed 

./ 

out, "In self -appraisal, any change in teaching behavior 
^^egins- with a need to know yourself." Secondly, they 
stated, "Changes in teaching behavior are most likely to 
occur in a threat-free atmosphere." Thirdly, they stated, 
"The participation of teachers in a program of self- 
appraisal must be completely voluntary. Freedom of choice 

■\ - . ■ ■ 

to enter and to leave the program must be an absolute 

guarantee for each teacher." A series of assumptions un- 
dergirding teacher self -appraisal have also been 'made: , 
(1) "Teaching is more than mental ' processes, ' more than i 
thinking. Basically it involves human interac tion--where 
learning is the objective." ( 2) " The chance for teaching 
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to improve will occur only when the teacher behaves dif- 
ferently." (3) "Teaching is not a single pattern of 'most 
successful' behavior. Each teacher, therefore, should be 
free to develop his own unique style of teaching." (4) 
"Teaching behavior can be changed by one person--the 
teacher. No amount of command or exhortation from another 
can actually change one's behavior." and (5) "Teaching 
behavior most readily changes when the teacher is provided 
objective data of his own teaching." 

One argument which may be made for teachers' 
self-reporting their perceptions of classroom behavior is 
that they are more likely to accept changes ijesulting from 
data which they were involved in developing. The American , 

Association of School Administrators ( 1964) reported: / 

/ 

During his tenure at Calumhia University, President / 
Eisenhovfer engaged a firm of • consultants to study / 
the University's organization. He is reported later, 
to have commented that the re su It ing document was, 
"the most expensive and least-read document the Uni- 
versity's lihrary ever acquired." 

They further reported: 

Every teacher knows that involvement is critical to 
learning. The effective survey, is one that y involves 
every person whose hehavior or attitude cou,nts in a 
prohlf^m. 
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M otti'^s^-^ion is another cri "--ical concep" this 

cor Tf=3:- it implies that * ose c ricern-- n -^t he :i.ware 

of r:: lem.in t '-e.. -tudie^ and v^.i'-it o see it 
:o:- ~^ant it e help lolve : 



Resea - -r/:-eI^ ting; Self -Repc r :3 
•CO Ob:, rr 

\ za, collec-ed for studies concer-1: z cla-.-rcom 

V 

behavior :ie from direct indirect measu . Indirect 
measures r :vide indicatorr. from which inferences may be 
made. Student attendance rates, student achievement, 
disciplinary referrals, and the number of library books 
checked ou - by students are among a myriad of such indi- 
cators. Direct measures call for input either from the 
teacher or from someone else observing teaching- learning 
interactions. Observers may include students, fellow 
teachers, -administrative or supervisory personnel from 
within the school district, or observers from sources ex- 
ternal to the school. Such data collection may ;or may not 
be systematic. With a wide variety of variables and an 
abundance of literature available, a conscious decision 
was made to devote the -following paragraphs to /recent 
literature relating systematic observation to ^elf-reports 

Several . recent researchers have approached the 
question, "How do teachers see themselves andjtheir 
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classrooms mp'--: son to uhe rbserv£-. 3 of trained 

obser-. ers? - -'/r.-L, e of obserring and b ng observed 

has been disc. sel. If self-reports ccul- be used for 
^making adniridr va -.ive decisions relative tc program, evaL • 
uating and p^i ; . self-repcrts could also provide di- 
rect in-serv c - ~ience. 

Be; ■: ofter. gather data c sending q.ues- 

tlonnaires, : , n^ires, or other self -reporting forniE 

to the popula .IciA .i-^ng studied. Is it reasonable to ex- 
pect reliabil ,7 responses which come from individuals 
untrained in :^ze of the particular instrument and 
possibly unlnz—'C-d as to the intended meaning of termi- 
nology used in --"^ instrument? A partial answer to this 
question was presented. by Worle (1972), who studied the 
effects of trai:-lng on the variance of teacher ratings, 
variance deper-d. " wo farzors. First, greater variance 
existed when ra-- -: -ised uixscaled items than when they 
used scaled i-e:nE This supported the view of Harris, 
Bessent, and Mclntyre (1969) that when a rater had spe- 
cific behavior items upon which to focus his attentioi,, 
the ratings tends- -30 beccme more uniform than when or^ly 
general terms "we^ - offered. Secondly, training did sig- 
nificantly alter \-ariance; however, it would be difficult 
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to o-taiir. reliable ratings using an extremely rt trr^i n- 
ing period. 

There are significant differences a: -^r^: the ir - 
s tru ctioinal activities of teachers (Cohen, 19::i Clasn- 
room observation instruments may he divided iutto :atego-y 
systems and rating systems. Category systems £-r . classi- 
fied as low- inference measures (Gage, 1S69), .: - the 
items focus on specific, denotahle, relatively bcjecti-ve 
behaviors. Rating systems are. co^isiderbd high« i.: i* er ence 
measures, because the observer must mal^e inferences from 
a series of events (Rosenshine, 1970).; 

The major disadvantages of c^ategory systems are 

the cost of using observers and the difficulty of specify-- 

f 

ing behaviors before they can be included in a category 
system. Rosenshine ( 1970; and others| have noted that the 

f 

disadvantages of rating systems inclijde (l) the halo ef- 
fect, (2) the error of central tendency, ( 3) leniency 
error (Power, 1973), (4) difficulty Jin calibrating "ac- 
tors, such as "excellent," ( Mou tly, j 19 69 ) , and (5) iffi- 

culty in recording high-inference items - systematica Lly 

1 

(Gage, 1969) . ^ . ' f ' 

■i 

Smmer ( 1968) discovered |hat teachers over-estii- 
mated, hy as much as 50 .percent, the amount of time their 
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ou-ilr had • alked during .-ne f . .n*- -ainute disc-as^ 
that ^=-- --achcr iaad con cted. J t: e teachers we ale 
xo 5s --a-:- the amcun-. of .. :.ude: . .r -.icipation be -.t 
than -neri:. 

Using a randoml" 3ele:;~ed sample of par ti - l , unts, 
it wa f c :nc. that ther e va- a d_.3cer-ible gap betvee;: 
teach ir perceptions of the . r classrc om practices and be - 
haviors and their actual performances, as revealed by 
actual classroom observations ( foung, 1973). ' 

KvidaLl;i(19 0) compared student e valu at i cn., f 
teach-rs with tesLcher s e If - evalu:.ations Data wer'. ob 
taint:: from a ten-trait scale, the Teacher Eating Scai.-, 
from 3oth teachers and students... and from tbe Trair Hank- 
ing form, used by each teacher and student to rank -ne 
ten traits in orcer of importance. A tendency was noted 
for composite self -evaluations of all teachers to oe simi- 
lar tc their studenxs' composite -valuations cf their 
teacher's ef fectiven ss . Teacher- and students agreed 
tha- ' Jlncwi-edge of " .e Suoject" Ls the cost important 
trait, v/hile "Per-rn:^i / -npearance- " is least importSLnt. 

Cwens { Sr~ j) r j=ipared -he perceptions of teacher 
coEpe-enc-, within and e,: thr-e groups of eSucc-tors,- 

. using the lastrument for the Ohss=v:ation of T-achta^ 
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ctivi i-rf. IITA. Classroor:' ".eacherSj administrators, and 
o.^le.- ■■ . r\-isors were in'v. ived ir^ reacting to data 
-"her .: - 7n: thirty-min: " ideo t -res cf six respondents. 
:wens ..^ded that tea':ri~:: are nzt as reliaole judges, 

c cl'j^. :t., behavior as c -allege supervisors. Adminis-,. 
-rator - . :-3ility ranked ' -.ween that of the other two 

rcur.^. --rs' res varr:i r 3p u q^uestion for investiga- 
-:3rs wi I- r 1- on teacher se T^reports of their.own.be- 
havior'i. If rells-bility is lacking in the more objective 
a2 livit;' of -aasuring compe-.enc ies of others, what jus.ti- 
ficati:?.n is there to assume greater reliability :::-S teachers 
-pproac;. tn- nnore si: i:^ j ec tir . area of se If - reporting? 

lavage (1970) st' died the validity of reacher 
seir- -porrs for predictiiig pupil and observer ratings 
of r---acher t: er f c rmance Involved in his study were 100 
ele rentary teac -rrs^ language ar^s/social i-ience 

■^^-:aer' and 121. mc:.*. ' ^iv^- ^ s/ s c i enc e, teacher-3. The cor- 

- 1 i:_:,c:: '^etwe-n pred ct-r-i and actual scores wa.: very low 

- -roups. C--^y scores cf mathemat ic s/ sc ience teach- 
ere -sl:.- tne "-.a-rr c:n rservation Record (COE . sub^ 
Stan- the hTI-^-^^^^s that s e If ^ reported responses 

car z-.e -.--d as Tigni .cant predictors of pupil effective- 
ness, judged by pupil and trained-observer responses. 
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In a study "by Peer. 1970), alassroor: reachers 
made se if -analyse s of tneL. v "bal behavior in the class- 
rocx an-J. a trained obse -rer ir. -c.e analyse/^ of the ^ame ^ 
havior using Flanders' .:a- i ri^es Tor I'J te rac tio," Analyses 
System ?eek concluded tna.: teach.er.s d:id not appear to 
be abl- to self ^analy::e t::e^ overall verbal be: .ivior ex- 
cept 1..... *.rie r;.rea of praising and encouraging students. 

One basic diTficu." ty in relating self - perceptions 
to Gbserv-ed behavior lies ..^ de termii:- ing the relationship 
between s elf -perception ani observed nehavior:, Benolds 
( 1972) found that tes^cher s^elf -acceptance ana gelf- 
satisfaction are related tc observed classrocm behavior. 

Ziirrrer ^ • ? ' ' studied the re latl"s:ilp^ between 
self-ev- J.U.: tloa3 and r^rervlsory ratings of f: :.rst~year 
Lutheran rle.raentary ^ : .^ol teachers vrc had ^aduated f rom 
Concordia Teachers :: .l^-x-, Rl-'er Forest... Illinois.. He 
found tha.t teacb^ - ■^'-.^''i s ::pe:r-v-i.sors agr-ee on" .-omt tilings 
and disagree on z:ner^. 3u':ervisor ratings c: s-^^ch fac- 
tors a.- nerscnal rual : f icat ^ons^ commi tmen t , t^rcf e s s ional 
qualil^ication 3, tc-achlng competence, and c lasnr-ooTn manage- 
ment corre lated posit'^vely with teacher se If -e^-alu ation 
factors such as adjustment to the school organ^zB-Gion^^ dif- 
ficulty -it . 2la£H: -ontrol, compatibility of £-:2slcx^.:nent. 
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and liking of work au present location and negati---' ly vrith 
using ovm ideas and plan.: for teachl ::g and satisf a^c t ic n 
with progress being made b- students 

Fillbrandt (lE'^l"' used nin- limensions cf teacher 
behavior, ^defined by Tlyai:.£ in Charac^ ristics of ^Teachers, 
to compare systematic or nervations wl'. \ ratings by teachers 
and their supervisors . "T -^^ ese diaens ic :_3 inc -uc rd DeTDO- 
cratic^ Responsive, Uiii- r r ::anding, ?:in:.Iy, S t imula:: ing < 
Original, Responsible,, Sys. ^emat.ic , and Optimist c .^navior. 
No significant relation saj.:: s betv^een ' o:;ings or se 
rating and tne in terac tl: oti of rat-: r -ricri-:ie:2 irr c^ass^ 
room behavior could be r "^ uni: . 

num ber of QbseT^ra oioix^s — 
Differing View;; 

Researchers d:-f.- -r::r on -^iz.:,o:.:.s e-S tc ::.ov many 
observations ar- needed ^ the sar:e te .:^cher be! ^r^ ^uch 
information may be usedv^-h con^id^-.nc e , Harris, essent, 
and Mclntyre ( 1969) em- ha.:: :.zed tri- -oinr. that r-li anility 
increases with mu It ^ ' l-'^ ; . rvsL--. 1 a:. :/'.".e n^ei^ tc be 
made of the informatl: .; gi=. .r-nered -.-hz-y^ zh sy-tet -t. oh- ' 
servations will, in par^, dete^rrmir.v ::b:e infoTmt -^.oti grasp 
required. . 
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Medley and Mitzei (1963) contended that is is 
bet:er to increase the number of oDservations than the num- 
ber cf observers. Instability of behavior over occasions 
givesrisetosamplingerror, 

Voege ( 1970) determined^ in a study of the pro- 
cedures for evaluating classroom teachers in Washington^ 
triat effectiveness of evaluation lay in the manner of its 
f rfcrnance more than in the frequency of teacher-evaluator 
c ant r acts • The number of observations is not important . 

Wells (1970) stated, "A more representative pic^ 
ture of the predominant teaching pattern being^ displayed - 
by a teacher is found by combining at least three ^fifteen- 
-inu e sample episodes of classroom verbal interaction/' 
:he instrument used in Wells's study was Flanders' Class-- 
room Interaction Analysis. 

Adachi (1971) reported that the third observa-- 
tion by individuals who had completed training in the In- 
strument for the Observation of Teaching Activities (-IOTA) 
vere consistent with IOTA consultants' scores of the same 
teacher's performance. 

More Comprehensive Observation Guide items were 
identified as significantly reliable at the .05. level by 
pooling scores from three visits than were obtained froto 
single-observation visits (Power^ 1973). 
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Observations for Improvement 
of Teaching 

If one use of classroom o'bservation is to im- 
prove teaching, then a case can~ he made for training teach- 
ers in observation techniq^ues. Teachers so trained would 
be in a better position to analyze and improve practices 
of themselves and of fellow teachers. Johnson (1971) sug« 
gested that teacher-colleague^ analysis of questioning 
skills might be an economical- method of improving class- 
room teaching practices. 

Moller (1968) found that first-year teachers 
listed fellow teachers most fj'equently as the one source 
from which they received the most help. Fellow teachers 
were followed by department chairman^ 14 percent; princi- 
paly 7 percent; assistant principal^ 4 percent; and super- 
visor^ 3 percent. 

Thomas (1972) found that teacher self -analysis 
of video tapes of own behavior leads to improvement. Teach 
ers viewed. daily video tapes of their own classroom be- 
havior and counted the number of times they engaged in de- 
sir ed behavior s . The frequency of each behavior category 
increased as the teacher counted it. 

Weeks (1972) developed an innovative approach 
to classroom observation. Each user of Weeks V system 
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selects ten ^behaviors for a series of observations to be 
made on his teaching in his own classroom by an observer . 
of his choice. The ten behaviors are selected from a 
master list of 199 classroom behaviors including cogni- 
tive,' effective, and psychomotor behaviors of teachers and 
students. Lists are pooled when a group of teachers are 
to observe one another. 

Coombs (1966) added a new dimension to describ- 
ing such teacher-student interactions as defining, explain- 
ing, comparing, and classifying in what he called ^the logic 
of teaching. He discussed eleven types of "moves" or 
verbal activities which introduce concepts . * Moves may be 
made by the teacher, rby a student, or by the teacher and 
one or more students together. Knowledge of such moves. 
Coombs contends,, enables^ the teacher to be more^ critically 
conscious of the progress of classroom 'discussions;, b\it 
no evidence is presented which would indicate that /these 
concepts had been validated or that they could be reliably 
recorded, either by the teacher or by outside observers. 
The eleven moves were: (l) criterion descri^^tion, (2) 
classification, (3) .analysis, ( 4 analogy, (5) differen- 
tiation, (6) positive instance, (?) negative instance^ 
(8) instance sub s tant iat ion, ( 9 ) instance production, (lO) 
enumeration, and ( 11) me tadis t inc tiou o 
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C Is^ssroom ObserT-atlcr: amd 
Sfcude r:t Perf onng.ace 



Medle:' ('i97'2' r:^d the Tollowing to say about the 
relationships beir/we^n cla-ssroom observation of teachers 
and -performance c:,f students under the tutelage of those 
teac he r s : - ' o 



There is co~^ . derable research evidence to show that 
teachers whc ^ re rared most effective are not really 
the. most eff? liive In this (that pupils show the 
greatest galxui while in her class); sense of the term. 
I' have searche^d the literature andj every study I 
have found whz^ch i^ompared supervisor ' s ratings or 
^■^udgments oil -i^^acher effectiveness With measured 
.^ains of rF3p;iL.:5 ( adjusted to eq.ualize ability levels, 
•etc.) har. f rnzin '± no a-pprec iab'le re la t ion shin between 
^hero. 



Altacug:h E,os:^n£hine (197G) made a valid argument 
for relating i:e:azher behavior to> pupil achievement, Cohen 
( 1973) pointed ::-i:t tha.-t interactions among students and 
between the te£.cl:iex and individT:::al students may also relate 
to st<3dent ac hlerement : 



Sociologists: point to structural factors in the or- 
ganization, cf teaching producing so much variability 
in how te,2i'clners carry out instructional activities 
that the ipasslbiiity of tioining up with systematic 
understas-ifjng of the conditions for teaching effec- 
tive nes s n::iiroui,gh inductive studies of teacher- talk 
and studerrt learning would appear very limited. \ 
Secondly, studies of the part ic ipation rates of stu- 
dents in typical classrooms suggest that a tutbrial 
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model of - teacher-student interaction will prove quite 
inadequate to explain student learning. There are ' 
typically too few students who have the chance to 
interact with the teacher. Thirdly, studies of the 
effect of classroom status systems on the teacher and 
on the students ' learning point to the necessity for 
condi tionali zing any statements concerning teacher 
effectiveness: learning partly depends on the formal 
and informal structure of the classroom. 



Literature cited thus far helps to establish the 
need for further .research concerning ; the relationship be- 
tween reported teacher self-perceptions and reports by 
trained observers. 

A Needs Assessment 

Selection of individuali 2iation of instruction 
as the area in which to collect data* was the result of a 
study which included assessment of the needs for future 
in-service teacher training in Texas. ■> 

"^'The study on in-service teacher training was 
conducted in the Spring of 1973, by the Division of Eval- 
uation' of the Texas Education Agency ( Nu tt, 1973). Par- 
ticipating in the study were independent school districts, 
education service centers, other divisions of the Te^^as 
Education Agency, and two professional teacher organiza- 
tions. These two organisations were the Texas Classiioom 
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Teachers association (TCTA), which represents classroom 
teachers^ and the Texas State Teachers Association (TSTA), 
representing a broad spectrum of Texas educators. 

As part of the study, respondents were asked to' 
assess the need for future in-service\ education among 
various types of activities. Analysis of data from school 
districts involved a stratified random sample. f A weighed^ 
frequency count was employed with high priority\^ mid- 
dle priority = 2, low priority = 1, and not ne^eded = 0. 
From the pooled total of all districts, individualization 
o^ instruction was the most needed area for in-service. 
In Strata I, districts with over 50,000 ADA, individuali za> 
tion of. instruction ranked 'number 22 among over, 100 possi- 
ble choices, while needs as ses sment s tudy ranked number 
one. In Strata II, distActs with*10, 000 to 49, 999 ADA, 
and in Strata V, districts with less than 500 ADA, indi- 
vidualization of instruction ranked number two. Training 
to help teachers to woi*k with special education students 
having emotional prob lems . was the prims concern in Strata 
Ilj while in Strata V., emphasis was given to the broad' 
area of elementary school teaching skills. Individualiza- 
tion of instruction was the priority area of respondents 
from Strata III, districts with 1,000 to 9,999 ADA and 
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strata IV, districts with 500 to 999 ADA, Texas Education 
Agency Officials ranked individualization as the sixth 
highest needed area for teacher in-service, with career 
education as suming highest priority. Education Service 
Center directors also saw career education as the priority 
in-sprvice need^ but ranked individualization of instruc-^ 
tion a close second. 

Questionnaires from Texas State Teacher Associa- 
tion members, saw individualization of instruction listed 
as third prior ity, behind developmental reading and de- 
velopment of skill in working with children who do not 
learn using traditional instructional methods. 

Members of the Texas Classroom Teacher Associa- 
tion indicated that they considered in-service in individ- 
ualization of instruction to be the. highest priority. 

School officials also reported areas in which 
in-service had been offered during the 1972-73 school term 
Training in individualization of instruction seemed to be 
a function of size. All districts in Strata I reported ; 
that individualization of instruction was an in-service 
education topic as did 94 percent of the districts in • 
Strata II, 69 percent of the districts in Strata II, 61 
percent of the districts in Strata IV, and 45 percent of 
the districts in Strata V. 

/ ' " ■ 43 ■ 



The Measuring Instrument 
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Instructional Leadership Materials, through the 
Office of School Studies and^'Surveys of The University of 
Texas at/^Austin, has made available self -reporting and 
observation guides for use in describing classroom behaviors 
in a/systematic manner. One instrument. The Descriptive 
Obs^ervatiori Record of Individualization of Instruction 
(riarris and Mclntyre, 1971) allows trained observers to 
record evidence as to the amount of five types of indi- 
vidualization of instruction: 

/'""■• . . 

I. Intra-class Grouping 
II. Variety of Materials 
III.. Pupil Autonomy 
IV. Differentiated Assignments 

V. Tutoring 

Another form of the instrument, the Individualization of 
Instruction Inventory, allows for teachers to report their - 
perceptions of the degree to which they individue^llze^ in- 
struction in each of these five categories. ' _ 

The present forms of these instruments evolved 
from those found in a set of "Comprehensive Observation 
Guides and Inventories" (Harris and Mclntyre, 1964). A 
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key step in the development of these instruments was the 
use of the "Basic Teaching Procedures Scale" and the "Class- 
room Behavior Scale" in a study, of the effects of demon^ 
stration teaching upon experienced and inexperienced teach-- 
ers (Harris, 1966; Coody, 1967). In this study, trained 
observer-analysts observed classroom teachers^ at the 
beginning and the end of the school year. Each observa- 
tion was for a duration of thirty minutes. Teachers were 
subjected to three supervisory approaches in order to test 
the effect of demonstration teaching on the teacher's in- ' 
dividualization of instruction. Factors which were re^ 
ported to be the best indicators of individualization of 
ins tru^b tion were incorporated in to the revised ins truir.en t s . 

1\ Williams ( 1968) used a se If -report form of the 
instrumen\ in his study of practices of' teacheT's in graded 
and nongraded classrooms. The degree to which teachers 
in nongraded classrooms reported their practices of in- 
dividualization of instruction proved not to be. signifi- 
cantly higher than those in graded classrooms. Another 
form of the instrument, the Special Classroom Observations 
Guide, was used by Murray (1971) in a study entitled '*.In- 
divxdualization of Instruction in Special Learning Disa- 
bilities Resource Classrooms: A Comparative Study." 
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MurrayVs study involved fifteeA elementary and fifteen 
junior high school learning disabilities resource teachers 
Each teacher was observed during at least one thirty- 
minute period by three trained rater s simultaneously. Sub 
seciuent to the observations/ teachers c omple ted a packet 
of r:iports which included a self-report form of the instru 
ment. Significant dif f ei;/ences were found between observa- 
tions and self-reports /n all aspects of individualization 
of instruction, with yteachers viewing their own practices 
in a more favorable/ light . 

D..^ta gathered by observers were also us^^d in ^5. 

study in wh.-^ch/'t'eacher s in districts where either :5.:-^ora- 

/ 

tory merhoe/ or traditional approaches to individua ::za- 
tion of> instruction in-service were offered were compared 
wi th)/observat ions , of teachers where individualization of 
j/fistruc tion was not a major area of in-service training. 
Teachers in districts where in-r.service training in the 
area of individualization of instruction had been offered 
were observed to individualize instruction to a greater 
extent than the other teachers (Heeney, 1973). 

Summary 

/J. J \ 

The interactions between teachers and students 

in. classroom situations may be observed systematically 
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by trained observers. Attempts to relate observed teacher 
behaviors to other factors such as student achievement or 
teacher self -perceptions have been inconclusive. 

The need for teacher in-service training in in- ^ 
dividualization of instruction was affirmed by superin- 
tendents, Education service center directors, state educa- 
tion agency personnel, and individuals from two major as- 
sociations of proi'esn ional educators. Lastly, the use of 
the De:3criptive Obse— nation Record of Individualization of 
In2:tru.2tion to descr be the degree of five varieties of r. 
individualization of instruction has been reviewed. 

The review of the literature fo"und in this chapter, 
information included in the theoretical, framework in Chap- 
ter I, and references appropriately located throughout the 
paper, will serve as a point of departure for future re- 
searchers . 
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C-HAPTER III 



PROCEDURES 



This cha: ter wi^l describe the methods and pros 
cecures used in collec":ing the data for this study. Method's 
used in selecting subjects and characteristics of the sub- 
jects vill be describe . Techniq.ues used to neasure the 
crit = ri^on variable, obsrerved individualization of instruc- 
tion, vrill be discusseci^ followed by an explanation of the 
measurenent techniq,ues used to obtain the predictor vari- 
able, self -reported individualization of instruction. Fi- 
nally, the statistical procedures used in the study will 
be described briefly. A complete explanation of statis- 
tical ^techniq^ues will be found in Chapter IV. 

Selection of Sub.iects 

Superintendents of 167 school districts within 
a lOO-nrile radius of Austin were contacvted by letter and 
invited to participate in the study. These superintendents 
vrere also asked if their district had provided teachers 
with in-service education specifically designed to help 
them to individualize instruction. Those interested in 

41 
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participating in the study were asked to identify a con- 
tact person within the district. Of the districts from 
which responses were received, the ten largest where in- 
service for TndividualiziVig instruction had not taken place 
were selected as well as ten districts with comparable 
average daily attendance (ADA) where in-service for indi- 
vidualizing instruction had taken place. 

^ Copies of the'Texas Education Agency Assignment. 
Code Sheets, TEA-637, for the 1972-73 school term of the . 
twenty participating districts were obtained from the 
management information center of the Texas Education Agency 
through the cooperation of Jerry T. Barton^ Research Di- 
rector. Teachers listed as be,ing at least half time in 
areas of language arts, mathematics, social studies, 
science v ? re laeritified and placed in &. pool from which a 
random sample could be drawn. Similarly, special educa- 
tion teachers were identified. Directories listing vo-c;a> 
tional or occupational education teachers were obtained 
from the Division of Public School Occupational Programs 
'of the Texas Education Agency, L. V. Ballard, Director. 
A sample of vocational, academic, and special education 
teachers, including at least two vocational and special 
education, teachers, was selected from each district. 
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Criterion Varia'b^ 

A team of \)bservers was trained by Will .am C 
Heeney, using Harris and Mclntjre^s Descriptive Observa- 
tion Record of Individualization of Instruction. Heeney 
reported an interobserverXreliability of .82. TAnining 
sessions included discussion^ of the instrunient ^nd in- 
structions on completing it. \ Observer trainees used a 
training film as a simulated observation, with observers 
filling in checklists independently followed by discussions 
of what observers recorded. Actual classroom observation 
as part of the training was conducted, iii zh^^ Oalr HiH Ele^ 
mentary School of the Austin Independent School District. 

Observation schedules were established ::n each 
participating district. District protocol was observed 
in that the contact person in some districts set observa^ 
tion schedules while in other districts observation sched- 
ules were developed in conference with campus principals 
or their assistants. 

Pr edic'tor Var lab le . 

In four of the dis/tricts the Individualization 
of Instruction Inventory Self-Report was completed by 
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teachers prior to classroom obvservation . Goodlad ( 1970) 
had noted a discrepency tjetween teacher knowledge of tech- 
nique individualization of instruction and classroom 
practices. Lamb (1970) revealed that the quality of teacher 
question was unaffected by prior knowledge that classroom 
observers would be using the Teacher Question Inventory. 

Conversely, an article in The Encyclopedia of 
Education by Furst (1971;18I), entitled ^'Classroom Observa- 
tion, Systematic/' cautioned against the use of classroom 
observii-ion for teacher evaluation:. 

Several researchers object to the use of their instru- 
ments for evaluation because they believe that teach- 
ers may' soon learn to falsify behavior patterns when 
they know they are being observed. Conversely, other 
teachers might become so self -conscious , that they 
could not act normally. 

It was hoped that collection of self-reports from 
some teachers before observation and from other teachers 
after observation would provide a particle of additional 
evidence for future researchers to consider in designing 

studies. 

I" 

\ Self -report forms of the Individualization of 
Instruction Inventory were mailed to each of the 364 teach^ 
ers participating^in the study. The forms were accompanied 
' by a letter arid a preaddressed stamped envelope. A 
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follow-up letter was sent to teachers who delayed in mail- 
ing back their self -reports • Where no response was ire- 
ceived, an attempt was made to contact each teacher hy 
telephone. As a final resort, during the week prior to 
keypunching of data, school districts where three or more 
self-reports had not been received were visited in person 
by the. researcher. The resultant return netted 335 self- 
reports of the 364 teachers who had been observed. ■ 

Intervening Variables 

The following information was obtained by ob- . 
servers and keypunched in addition to scores on the Indi- 
vidualization of Instruction Inventory: 

Observer School level 

District Teacher's ethnic background 

In-service program Number of Anglo s tudents 

of district 

Teacher identification Number of Black students 

Teacher assignment Number of Mexican-A\ierican 

students J 

Teacher sex Total, niimber of students 

in class 
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Multiple Linear 
Regress ion Analys is 

Multiple linear regression was chosen as the 
major statistical analysis technique to he used in^ this 
study hecause of its versatility and power as a resV^rch 
tool. It is hasically a technique in which a criterion, 
(or dependent) variable Y is predicted from a set of pre- \ 
dictor (or independent) variahles X.^^^^^. The'general 
equation for computing a subject's criterion score (pre- 
dicted criterion score f) takes the form: 

Where t is the predicted criterion score 

\ W]_ is a weight for a predictor 

^ is a predictor score 

K is the number of predictor variahles. 

Since there is an error or. discrepancy between 
the predicted score and the subject^s actual criterion 
score Y (signified by Y -^), the equation for the sub- 
ject's actual criterion score takes the form: 

Y = Y + E = WiXi + W2X2 + ... Wj^X^ + E. 
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Where E is the error of prediction: Y - The task of 

mfultiple linear regression is to seek a set of weights 
whicli, when applied to the respective raw scores of each 
subject, will yield, a set of error values wi^th a minimum 
prediction error. <Teldman, 1967:281-282). 

Program LINEAR (Jennings, 1971) on file at The 
University of Texas Computation ^Center was the principal 
program, used to perform the statistical tests of the hy- 
potheses . ' 

Summary 

Observations hy trained observers using the De- ^ 
scriptive Observation Record of Individualized Instructiorj 
were compiled on 345 teachers, who also completed a self- 
report of the Individualization of Instruction: Inventory. 
Subjects consis.ted of vocational^ academic, and special 
education teachers housed in elementary. Junior high, or 
high schools of twenty independent school districts located- 
within one hundred miles of Austin, Texas- D,,ata were 
punched onto carets and analyzed on the CDC 6600 computer . 
of The University of Texas at Austin,' using the statisti-- 
cal computer program LINEAR developed by Jennings (197,1). 
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CHAPTER IV 
FINDINGS OF THE STUDY 



The primary purpose of this study was to submit 
to systematic inquiry the self-reported estimates of in- 
dividualization of instruction as compared with the ob- 
servations of the same teachers hy trained observers. This 
purpose was to he served. by testing the three hypotheses 
irrespective of affirmation/ disaf f irmation, or inconclu- 
siveriess of the tests, of these hypotheses. 

A secondary purpose of the study was to develop 
a set of factors for converting self-reports of individ- 
ualization of instruction obtained from the Teacher Ques- 
tionnaire of the Individualization of Instruction Inven- 
tory into scores which would be reasonable predictions of 
scores recorded by trained observers. 

This study was designed to provide information 
concerning the relationships between self -reported prac- 
tices of vocational, academic, and special education teach- 
ers and observations of such practices as reported by 
trained observers. Are teachers* se If - re por t ed scores of 
individualization of" instruction practices on the Indi- 
vidualization of Instruction Inventory higher than scores 
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of observers using the same instrument? Do discrepancies 
"between scores derived from teachers* self -reports of 
individualization of instruction practices on the Individ- 
i^alization of Instruction Inventory and scores from ob- 
servations made using the same instrument increase as the 
degree of individualization of Instruction^ reflected from 
observations^ decreases? Do scores- derived from teachers* 
self-reports of individualization of instruction vary in 
a systematic way from scores derived from observations 
made using the s ame ins trumen t? These are some of the, 
question^; the study attempted to answer. 

The Sample 

Computer analyses were performed on data repre- 
senting 335 teachers from twenty school districte located 
within one hundred miles of Austin, Texas. In the same 
were 200 academic, 86 vocational, and 49 special education 
teachers, A total of 169 were in ten districts which had 
offered in-service training in . the individualization of 
instruction; 166 were in ten districts where other topics 
were emphasized during in-service teacher training* In 
each set of ten districts, self-reports were collected 
prior to observation in two districts and subse-q.uent to 
observation in eight districts. 
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The Three Studies 

Data collected during the course of this study 
were to be used in three separate but interrelated reports. 
The focus of this report is a comparison of observed and 
self -reported individualization of instruction of voca- 
tional, academic, and special education teachers . Another 
study described differences of observed practices of in- 
dividualization of instruction among teachers exposed to 
different in-service teacher training activities (Heeney, 
1973). In a third study, findings of the first two are 
to be analyzed in relation to specified demographic factors 

The hypotheses were presented in Chapter I. The 
literature relating systematically observed classroom 
practices and self-reports of such practices was reviewed 
in Chapter II- The design and procedure for executing the 
study were discussed in Chapter III. The present chapter 
will describe the results. 



Multiple Linear 
Regression Analysi s 

Formulas for, multiple linear regression were 
presented in Chapter III. The general equation may be 
written as \^ 

\ 

^ / ■ 
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^ = WiXi + W2X2 = . . . WkXk- 
Where ? is the predicted criterion score 

Wj_ is a weight for a predictor 

Xi is a predictor score and 

K is the number of predictor variables. 

Considering the discrepancy between the predicted score ^ 
and the subject \s actual score the error of prediction, 
y - the equation, for the subject's actual scor<? takes 
the form: 

Y •= ^ + E = W3_X3_ + WgXg + . . . Wj^Xj^ -f E. 

V/here E is the error of prediction: v ^ "? . 

Multiple linear regression analysis may be used 
to indicate the prabability that a criterion variable is 
or is not statistically related to a set of predictor 
variables, but cause and effect judgments are subject to 
interpretation. ' 

McNemar (1969:196) cautions: 

Suppose that we have a dependent variable . and four 
independent variables which might be used in the de- 
pendent variable. The cause and effect, as opposed 
to concomitant, relationship among variables is a 
logical problem which must be faced by the investi- 
gator as a logician rather than as a statistician. 
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Stuff le-beam and others ( 1971:142) testify . to the 
value of multiple regression analysis while echoing McNemar's 
caution: 



An associational technique of utility with a large 
number of variables is multiple regression analysis^ 
with the concept of contribution to t»otal variance 
being the inc lu s ion^exc lu s ion criterion in refining 
the mathematical model. While most techniques are 
based on use of one dependent variable, canonical 
analysis is based on a model of multiple independent 
and dependent variables. Most association techniques 
are dependent upon logic and time sequence to estab- 
lish the causal network. Causality, in the sense of 
cause and effect in the experiment, is never unequivo«- 
cally established in correlational analysis; however, 
correlational analysis is a workable tool for pre^ 
diction. 



Veldman (1967:294) describes multiple correla^ 

tion thus: 



Multiple correlation may be considered a special case 
of the more general correlation model, with multiple 
predictors on one side and a single criterion on the 
other. The analytic procedure determines a set of 
weights for the predictor variables (X^) which yield 
a composite variable (?) that correla'tes maximally 
with the criterion variable (Y). 



Since Veldman referred to multiple correlations 
as a special case of canonical analysis, clarification 
of the later term is appropriate^ 



The goal of canonical analysis is to define the pri- 
mary independent dimensions which relate one set of 
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variables to another set of variables . .■ . . The 
output of a canonical analysis should suggest answers 
to q.uestions concerning the number of ways in which 
the two sets of measures are. related, the streng;ths 
of the relationships, and the nature of the relation- 
ships so defined* 

Veldman (1967:282) summarized the chief value 
of multiple linear regression by saying 

the linear-regression approach to an a ly sis of vari- 
ance offers the investigator the possibility of mak- 
ing more precise tests of his hypotheses without many 
of the usual assumptions of traditional analysis of 
variance procedures. 



Garrett (1966) offered four limitations to be 
considered in using partial and multiple correlations. 
First, linear regression is necessary. Secondly, the num- 
ber of cases should be large. Thirdly, the influence of 
factors is not clear cut; and, lastly, the sampling error 
may be cumu lat ive . 

In this study, multiple linear regression analy- 
sis was employed to examine variables relevant to the pre- 
diction of the criterion, observed individualization of 
instruction, in order to determine which variables con- 
tributed to predictive efficiency. Also of iaportance 
was the possibility that the relationship of one predictor 
to the criterion depends upon the value of a second 
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predictor, considered simultaneously with all weighed pre- 
dictor variables. 

Program LINEAR (Jennings, 1971) was the princi- 
pal program used to perforin the statistical tests of the 
hypothese s . This program is on permanent file at The 
University of Texas Computation Center. It is a flexible 
program which permits the manipulation of data. Readers 
interested in learning more about the versatility of multi- 
ple linear regression are referred to Introduction to 
Linear Models by Ward and Jennings (1973). 

The basic fuli model for the study was 

Y = Yj^Xx + WgXg + + W^X^ + E 

where the values were dependent on the relationship being 
tested at that time. For example, in the test of equal 
differences by levels for all subjects, the full model was 

Y = WiXi + WgXg + W3X3 + E ■ 

in which Xi was "1". if the as sociated criterion score was 
related to self -reported scores 76 and below, "0" other- 
wise; Xp was "1" if the associated c r i t e riran-'H-^Tor e was 
related to teacher se If - reported scores 77 through 88, 
"0" otherwise;., and X3 was "1" if the associated criterion 
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scores was related to self -reported scores of 89 and above; 
and where the following set of restrictions could "be im- 
posed: 

- Wi = Co = Constant 
Wg = Co + Wi 
W3 - W], = 2Co 

W3 = 2Co + Wi 

therefore 

Y = WiXi + (Co + Wi) X2 + (2Co + Xi) X3 + E 
= WiXi + C0X2 + W1X2 + 2C0X3 + W1X3 + E 

= W (Xi + X2 + X3) + Co (X2 + 2X3) + E 
= W]_U + Co (Xg + 2X3) + E 

where 

U = (Xi + X2 + X3). 
The restricted model was 

Y = A^U + Co (XgSXj) + E^ 

where values for Co, W]_, W^, and W3 were determined from 
the full model. 
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Continuing the example of the test for eq.ual dif- 
ferences by levels for all subjects^ the following values 
were determined from the full model: 

Co = 4.83 ^ 5 
Wi = 22. 2Q ^ 22 
= 27. 20 27 
VJj = 32.04 ^ 32. 

The restricted model imposed the restriction that being 
in one of the three levels makes no significant contribu^l 
tion to prediction. Only one type of restriction was im- 
posed on the basic full model at a time. Each predictor 
vector was removed from the full model> one at a time^ to^ 
determine the effect of that predictor in the full model. 
The results of the example cited were presented in Table 
4.6. Statistical tests in this study employed subroutines 
of the standard computer program LINEAR ( Jennings, 1971) 
utilizing full and restricted models of multiple linear 
regression analysis. 

The restricted model compared to the full model 
permits computation of F-Tes t valu es u sef u 1 in testing 
hypotheses. * The formula used for the F-Test is: 

(SSSj^ - ESSp)/df2; 

F = ; . • 

SSSp/df^ ' 
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Where: 

ESStd = Error sum of squares of the restricted model. 
R 

ESS-r. = Error sum of sq.uares of the full model, 

- Degrees of freedom--the number of linearly 

independent predictors in the full model, minus 
the number of linearly independent predictors 
in the restricted model, 
dfg = Degrees of freedom--the number of elements in 
Y (Number of Sub J ec ts ) ^ minu s the number of 
linearly independent predictors in the full 
model . 

The First Hypothesis Tested_ 

The first hypothesis postulated that teachers' 
self -reported scores. of individualization of instruction 
would; be higher than scores recorded by observers. Stated 
as a directional hypothesis, it was: Teachers' self- 
reports of individualization of instruction practices on 
the Individualization of Instruction Inventory will yield 
higher scores than observations made using the same in- 
strument. For the purpose of applying the F-Test, this 
directional hypothesis was restated so as to postulate 
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TABLE 4-1 
SELF-OESERVED SCORES SUMMARY 

Means Standard Variance 
Deviations 



Observed Intraclass Grouping 


13. 


1370 


6. 


7717 


45. 


8559 


Observed Variety of Materials 


11, 


0350 


5. 


,^658 


29. 


8530 


Observed Pupil Autonomy 


12, 


.8834 


6. 


0531 


36, 


6395 


Observed Differentiated Assmt- 


13, 


,2507 


5. 


,0377 


25. 


,8847 


Obse^rved Tutoring 


8. 


.4956 


3, 


.9904 


15. 


,9235 


Observed Total Score 


58, 


.3615 


21, 


.2120 


449. 


,9509 


Self Intraclass Grouping 


17, 


,7930 


4. 


.4781 


20.0534 


Self Variety of Materials 


' 17, 


.3207 


4, 


.2805 


18. 


.3228 


Self Pupil Autonomy 


17, 


.9038 


3. 


.5034 


12. 


.2735 


Self Differentiated Assmt. 


16 


.8047 


3.8973 


15. 


.1892 


Self Tutoring 


12 


.6647 


3 


.9907 


15 


.9255 


Self Total Score 


82 


.4:636 


15 


.3694 


236 


.2195 



\ 

\ 
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eq^uality: self-report total scores on the Individualiza- 
tion of Instruction Inventory are equal to observation 
total scores on the same instrument. The F-Test proba- 
bility was 0.000, which was significant below the 1 per- 
cent level. The predicted mean self-score was 82.47j the 
predicted mean observation score was 58.36, yielding a 
difference of 24.11. One could conclude that self-scores 
were consistently higher by a sizable margin. 

inspection of Table 4-1 reveals that means for 
self-reported scores for each category of individualiza- 
tion of instruction were higher than the observed score 
in the same category. Standard deviations and variances 
were higher for observed scores than for self -reported 
scores in all categories except s elf- tu tor ing . The mean 
for the total se If - reported score was 82^.4636. and the 
standard deviation was 15.3694; while the mean for the 
total observed score was 58.3615 and the standard devia- 
tion was 21.2120. 

The relationships or correlations among each of 
the means displayed in Table 4-1 were tested. These cor- 
relations are displayed in Tables 4-2 and 4-3. All cor- 
relations were positive, but none was .90 or greater. The 
fact that none of the scores of the five parts of the 



TABLE 4-2 

COREELAIIONS OF OBSERVED SCOBSS WITH SELF-REPORTED Alffl OBSERVED SCORES 
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Self Total Score 


.3434 


.2969 


.2692 


.3402 




,01 


Obsemd Intraclass Grouping 


1.0000 


r* ^ Tl 

.5431 




7109 




8289 


Obsenred Variety of Materials 


.5431 


1.0000 






4624 


6428 


Observed Pupil Autonomy 








6431 


.3370' 


.6784 


Observed Differentiated Assiat. 






6431 


1.0000 


.5289 


.8992 


Observed Tutoring 






3370 


.5289 


1.0000 


.7135 


Ooserved Total bcore 




6428 


.6734 


.8992 


.7135 


1.0000 


Self Intraclass Grouping 


.4071 


.2616 


.2985 


. .3644 


.2753. 


.4071 


Self Variety of Materials 


.1556 


.2791 


.iU/o 




1090 


1976 


Self Pupil Autonomy 


.1773 


.U40 


.2516 


.1792 


.0495 


.1898 


Self Differentiated Assmt. 


.3439 


.2672 


.2531 


.3570 


.2188 


.3551 


Self Tutoring 


.2060 


.1840 


.U23 


.1933 


.2803 


.2534 



0) 
0 
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'ABLE 4-3 



COREEMIONS OF SELF-REPORTED SCORES WITH SELF-RLPORTED AND OBSERVED SCOPES 
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Self Total Score 


7QAQ 


7flU 


. f Jt:! 


8152 


6742 


1 0000 


Observed intraciass irrouping 


LOl] 






3439 


2060 


.3454 


Observed variety qi Materials 




/'7C)1 




' ■ ?fi72 


1840 


.2969 


Observed Pupil Autonomy 




iri7fl 

g iU f 0 




2531 


11?3 


.2692 


Observed Differentiated Assmt, 








. JO I V 


1933 


.3402 


Obrer/ed iutoring 








2188 


.2805 


.2490 


Observed Total Score 


,4Ufi 


.ly/b 








3740 

c U ( TV 


Self Intraciass Grouping 


1.0000 


.5067 


.4791 


.5750 


.4271' 


.7909 


Self Variety of Materials 


.5067 


1.0000 


'.4860 


1 5911 


.3697 ■ 


.7814 


Self hipil Autonomy • . 


.4701 


.4860 


1,0000 


.5416 


.3649 


. .7544 


Self Differentiated Assit. 


.5750 


.5911 ' 


" .5416 


1.0000 


.4123 


.8152 


Self, Tutoring 


.4271 ■ 


f.3697 


•• .3G49 


.4123 


LOOOO; 


.6742 
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instrument correlates -at the .95 level or greater with 
the total scores indicated that each of the five parts 
of the instrument were necessary to obtain a total com- 
posite score. Strongest relationships were generally noted 
between component parts and the total scores. An excep- 
tion to this was that the correlation between observed 
pupil autonomy and observed intraclass grouping was .7496, 
while the correlation between observed pupil autonomy and 
the observed total score was calculated to be .6784. The 
strongest relationships included those between (l) ^ob- 
served total score and observed differentiated assign- 
ments, .8992; (2) observed total score and observed intra- 
class grouping, ,8289; (s) self-total score and self-, 
differentiated assignment, .8152; and (4) self-total score 
and self-intraclass grouping, .79 89. 

Examination of self -reported scores and observa- 
tion scores revealed some isolated incidences, usually 

toward the high or, low extremes, in which observed j scores 

■ ' . i 

were higher than self -reported; however, it was demon- 
strated statistically that self -reported scores tended 
to be higher than observed scores. 

Table 4.4 presents predicted mean scores of 
vocational, academic and special education teachers. The 
. / • 
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TABLE 4-4 



PREDICTED MEAN SCORES'^ OF VOCATIONAL, ACADEMIC 

/ 





AND SPECIAL EDUCATION TEACHERS 






Type of 
Teacher 


Source 


^^^^PredrfEedP 
""^ - Mean — 


st andard 
Deviation 


Variance 


Vocational 


Self-reported 
Observed 


86.28 
63.98 


12.33 
20.18 


152.02 
407.23 


Academic 


Self-reported 
Observed 


80.89 
55.44 


16.31 
. 21.35 


266.00 
455 . 67 


Special Education 


Self-reported 
Observed 


82.37 
62. lo- 


14.95 
19.43 


223.42 
277.55 



^Predicted scores are calculated by th^ use of the actual scores. The 
predicted score is a score that will produce the smallest error sum 
of squares. This is done by subtracting the actu^a score from the 
predicted score, thereby obtaining an brror score. The error score is 
squared and summed to obtain the error sum of square. 
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mean predicted sfclf-re ported score of vocational teachers, 
was 86.28, while the mean predicted observed score was 
63.98, yielding a difference of 22.30. Special education 
teachers recorded the lowest difference, 20.27, between 
a mean predicted self -reported score of 82#37 and a mean 
predicted observed . score of a2,10. Lowest predicted means, 
80.89 self -reported and 55.44 observed, were recorded- for 
academic teachers who also. were noted to have the greatest 
difference, 25.45. • 

The Second Hypothesis Tested 

The second hypothesis theorized that the self- 
reported scores of teachers who were observed to be in- 
dividualizing instruction more would be closer estimates 
o.; the degree of individualization of instruction than 
self -reported scores of teachers who were observed to be 
individualizing instruction les s . The hypothesis state- 
ment was: Discrepancies between scores derived from teach- 
ers' self- reports of individualization of instruction 
practiced on the Indiyiduali za t ion of Instruction Inven- 
tory and scores from observations made using the same in- 
strument will increase as the degree of individualization 
of instruction, reflected from observations, decreases. 
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In order to test the hypothesis, it was assume.d that the 
mean of the observation scores (58.3615), as reflected 
in Table 4-1, was a reasonable point of division into 
upper and lower observation scores. For the purpose of 
applying the F-Test, the second hypothesis was restated 
so as to presume equality: the differences between self- 
and observation scores, with observation scores above the 

mean, are equal to the differences between self- and ^b- 

/ 

servation scores below the mean. The F-Test probability 

/ 

was 0.000, which was si^^nificant below the 1 percent level. 
The below-the-mean difference was 36.28 and the above-the- 
mean difference was 10|'.65, yielding a discrepancy of 25,63 
between the two groups. One concludes that the lower ob- 
servation scores ha-vej a greater difference than the higher 
scores, thus confirming the second hypothesis, 

A reproduciion of the computer print-out is„ in- 
cluded in the Appendix on which self -reported scores on . 
the Individualization of Instruction Inventory were plotted 
"along the horizontal axis and observed scores were plotted 
along the vertical axis with the lowest possible score 
(twenty-five) at the upper leftj. It ^-:as included so that 
• future researchers 'would be able to verify findings of 
this study and also to provide additional evidence of the 

\ 
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confirmation of hypotheses one and two. Since self -reported 
scores were generally higher than observed scores, it was 
practical to subtract observed scores from self -reported 
scores for purposes of data ' analys is , A graphic representa- 
tion of self-scores minus observed scores plotted agaiast 
observed scores is also presented in the Appendix. Visual 
inspection of this plot helped to confirm that lower ob- 
servation scores have a greater difference than the higher 
. scores • 

The Third Hypothesis Tested 

The third hypothesis dealt with (l) a systematic 
relationship between self-reports and observations and (2) 
use of self -reported scores of individualization of in- 
struction to assess general practices of a population of 
teachers. The third hypothesis was stated thus: Scores 
derived from teachers' self-reports of individualization . 
of instruction practices .will vary in a systematic way 
from scores derived from observations made using the same 
instrument, ,so as to permit the development of a set of 
factors for converting self-reports of individualization 
of instruction obtained from teacher £ie If -report s into 
scores which would be reasonable predictors of scores 
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recorded by trained observers. In order to test this hy- 
pothesis, a number of statistical tests, all employing 
multiple linear regression, were employad. These tfists 
included tests of equal difference, self-scores minus ob- 
served scores plotted against self-scores, tests for linear- 
ity, tests for equality of levels, and comparisons of 
F-Tests for subgroups. The essence of all these statisti- 
cal tests, each of which will be discussed subsequently, 
was that self -reports of the total sample were divided 
into three levels which may be used to predict similar 
levels of scores reported by trained observers. 

Dividing lines for the three levels were found 
to be one-half standard deviation above and below the mean 
of self -reported scores. Scores derived from teachers' 
self-reports of individualization of instruction into 
scores which were reasonable predictors of scores recorded 
by trained observers was developed. These factors included 
the following three levels: (l) for socres,76 and below-- 
subt^act ?2 points; (2) for scares 77 through 88--subtract 
27 points; (s) for scores 89 and above--subtract. 32 points. 
At this point, the author cautions the reader that this 
relationship and these factors applied only to the total 
sample tested in this particular study. This relationship 
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was not confirmed for various subgroups, nor could gener- 
alizations be made from only one study. 

Tests of Equal Difference by Levels , Table 4.5 
shows the results of the test of equal difference by levels 
for all subjects. Three discrete variables which are 
shown along the horizontal axis included: (l) 76 and be-- 
low- - self -reported scores more than one-half standard devia- 
'tion below the mean; (2) 77 through 88-^self -reported 
scores betv/een one-half standard deviation "below the mean 
and one-half standard deviation above the mean"; and (3) 
89 and above--self -reported scores more than one-half Stan- ■ 
dard deviation above the mean. The difference between 
self -reported scores and observed scores is plotted on 
the vertical axis. Graphic presentation of both the :"ull 
model predicted values and restricted model showed that 
self -i-^eports of all respondents in the sample tested could 
De divided into three groups with an equal difference of 
approximately "five points separating the mean self-scores 
ninus observed scores. The approximate self-score minus 
observed-score level for scores 76 and below was 22; for 
scores 77 through 88, it was 27; and for scores 89 and 
above, it was 32. The probability of eqr^l difference by 
levels for" all subjects was .9801. This high probability 
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TABLE 4.5 



TEST OF EQUAL DIFFERENCE BY LEVELS --TOTAL 
40 r- 



30 



Self Minus 
Observed 



20 



10 



Level 



76 89 
and and 
Below 77-88 Above 



run 22.26" 27.20 32.04 

Restricted 22.29 27.17 32.05 



75 
and 
Below 



77-88 



89 
and 
Above 



Self -Report Levels 
Full Model Predic.ed Values 
Restricted Model Predicted Values 



Probability .9801 
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of equal differences by levels applied only to the total 
sample. Table 4.6 indicates that the probability of equal 
differences by levels for vocational teachers was only 
.1544. Special education had the highest probability 
(.8968) of equal differences by levels, as shown in Table 
4.7. A low probability (.2163) of equal differences by 
levels for academic teachers is displayed in Table 4.8. 
The constant error for all subjects (Table 4.5) was sp- 
proximately 5. It is interesting to note that while the 
constant error for academic teachers ( Table 4.8) was ap- 
proximately the constant error for vocational teachers 
(Table 4.6) was 6.75, or 1.75' above 5; and the constant '[ 
error for special education teachers was 3.24, or 1.76 
below 5. TP.ble 4.9 indicates that the probability of equal 
difference by level for teaichers in districts which had 
offered in-service in the individ.ualiaation of inatruction 
was .1386 and the constant error was 5.46. The proba- 
bility of equal difference by levels for teachers in dis- 
tricts which had rot offered in-service in individualiza- 
tion of instruction is shown in Table 4,10 to be .0998, 
while the constant error was 4.37. 

TesJ^ f by Level . Vcjational and 
acadeinic teachers were probably not equal ( probability-- 

7 0 I 



TABLE 4.6 



TEST OF EQUAL DIFFERENCE BY LEVE L- - VOCATI ONAL TEACHERS 



Self Minus 
Observed 



40 



30 



20 



10 




Level 



76 89 

and and 
Below 77-88 Above 



Full 19.79 19.96 31.85 

Restricted 17.12 23;87 30.62 



76 
and 
Below 



77-88 



89 
and 
Above 



Self-Report Levels 
Full Value Predicted Values 



Restricted Model Predicted Values 

Probability .1544 
Constant Error S.75 , 
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TABLE 4,7 
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/ 



30- 



/ 

/Self 
Minus 
Observa- 
tion 



20 



10 



OB- 



TEST OF EQUAL DIFFERENCE BY LEVEL-- 
SPECIAL EDUCATION TEACHERS 




76 
and 
Below 



Level 



76 89 
and and 
Below 77-88 Above 



Full 24.17 26.76 30.55 

Restricted 23.90 27.14 30.39 



77-88 



89 
and 
Above 



Self-Report Levels 
Full Model Predicted Values 



; Restricted Model Predicted Values 

Probability .8968 

Constant Error = 3.24 
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TABLE 4.8 



TEST OF EQUAL DIFFERENCE BY LEVEL- -ACADEMIC TEACHETTS 
40 r ! 



30 



Self 

Minus 20 
Observa- 
tion 



10 




76 
and 
Below 



Level 



Below 77^88 



89 
and. 
Above 



Full 22.63 
Restricted 23.49 



30.47 32.57 
26.46 33.43 



\ 



77-88; 



89 
and 
Above 



Self-Report Levels 
Full Model Predicted Values 



Restricted Model Predicted Values 

Probability .2163 
Constant Error =4.97 
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TABLE 4.9 

TEST OF EQUAL DIFFERENCE BY LEVEL- - IN - SERVICE 1 AND 2 



40 r 



30 



Self 
Minus 

Observa- 20 
tion 



10 




76 
and 
Below 



Level 



76 89 
and and 
Below 77-88 Above 



Full 22,82 24.17 33.16 

Restricted 21 .30 26.76 32.22 



77-88 



89 
and 
Above 



Self-Report Levels 
Full Model Predicted Values 



Restricted Model Predicted Values 

Probability .1586 . 
Constant Error = 5.46 u 
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TABLE 4.10 



TEST OF EQUAL DIFFERENCE BY LEVEL- - IN - SERVICE 3 



40,- 



30 



Self 
Minus 

Observa- 20 
tion 



10 




Level 



76 89 
and and 
Below 77-88 Above 



Fun 21.84 30.42 30.68 

Restricted 23.14 27.51 31.89 



77-88 



m 

and 



76 
and 

Below Above \ 

Self-Report Levels 

Full Model Predicted Values 



. Restricted Model Predicted Values 

Probability .0998 
Constant Error = 4.37 
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.0341) by the three levels tested: (1) 76 and below, 
(2) 77 through 88, and (3) 89 and. above^ as is shown in 
Table 4.11. The probability of equality of levels for vo- 
cational and special education teachers is shown in Table 
4.12 to be .4:^44. Special education and academic teachers 
are shown in Table 4.13 to have the highest probability 
(.7531) of equality by levels. A low probability (.1666) 
of equality of levels for teachers in schools which of- 
fered in-service for individualizing instruction and teach- 
ers in districts which did not offer in-service for indi- 
vidualizing instruction is shown. in Table 4.14. 

Test for Interaction . All testa for interac.*-.ion s 
failed to provide evidence of intereaction bet^^een sub- 
groups of subjects. The probability of interaction between 

1 ' 

vocational and academic teachers is shown in Table 4.15 to 
be .1146. The probability of interaction between voca- 
tional and special education teachers, revealed in Table • 
4.16, was .4648. Special education teachers and academic 

teachers are shown in- Table 4.17 to h,ave a probability of ^ 

i 

interaction of .6 9 7 5 * Examination of Table 4.18 reveals 
low probability (.0856) of interaction between teachers ih.v 
districts whicfe^" had offered programs of in-service in ir.di- 
vidualizat ion o f in s t ru c t ion and teachers in districts 
where such in-service was not offered. 
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TABLE 4, 11 

TEST FOR EQUALITY BY LEVELS --VOCATIONAL TEACHERS 
AFD ACADEMIC TEACHERS 



30 



Self 
Minus 
Observa- 
tion 



10 



0 




Level 



76 89 
and and 
Below 77-88 Above 



Vocata onal 1 9 . 78 19.97 3 1 . 85 
Academi c 22.63 30 . 46 32 . 58 



J. 



jL 



77-88 



89 
and 
Above 



76 
and 
Below 

Self-Report Levels ^ 
Full Model Predicted Values— Vocational 

Full Model Predicted Values— Academic 



_.L— Restricted Model Predicted Values for Vocational 
/ and Academic 

Probability .0341 



86 
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TABLE 4.12 

TEST FOR EQUALITY OF LEVELS--VOCATIONAL TEACHERS AND 
SPECIAL EDUCATION TEACHERS 



30 



Self 

Minus 20 
Observa- 
tion ' 



10 




Level 



76 89 
and and 
Below 77-88 Above 



Vocational 19.79 19.96 31.85 
Special 

Education 24.17 26.76 30.55 



S?^ — 
and 
Below 



89 
and 
Above 



Self-Report Levels 



Restricted Model Predicted Values for Vocational , and 

Special Education 

Full Model Predicted Values— Vocational 

Full Model Predicted Values— Special Education 

Probability .4944 
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TABLE 4.13 

TEST FOR EQUALITY OF LEVELS- - SPECIAL EDUCATION TEACHERS 

ATID ACADEMIC TEACHERS 



30 



Self 

Minus 20 
Observa- 
tion 



10 




Level 



76 

and 
Below 



89 
and 

77-88 Above 



Academic 22*63 30.46 32.57 
Special 

Education 24.17 26.77 30.55 



i 1 1 - 


-76 j 


77-88 89 


and 1 


and 


Belcw 


Above 




i /-Report Levels 


Full ^^r 


del Predicted Values^-Academic 



Full Model Predicted Values—Special Education 

Restricted Model Predicted Values for Special 

Education and Academic 



Probability .7531 



88 



80 



TABLE 4.14 

TEST FOR EQUALITY OF LEVELS-IN-SERVICE I AND 2 
AND IN-SERVICE 3 



30 



Self 

Minus 20 
Observa- 
tion 



10 




Level 



76 89 
and and 
Below 77-88 Above 



In-Service 1 & 2 
In-Service 3 



22.81 24.17 ^3J8 
21.85 30.42 30.68 



76 
and 
Below 



77-88 



89 
and 
Above 



Self-Report Levels 

Full Model Predicted Values--In-Service 1 & 2 

Full Model Predicted Values--In-Service 3 

Restricted Model Predicted Value--In-Service 1 & 2 and 
In-Service 3 



Probability .1666 



89 
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TABLE 4.15 



TEST FOR INTERACTION--VOCATIONAL TEACHERS AND 
ACADEMIC TEACHERS 



30 



Self 

Minus 20 
Observa- 
tion 



10 




76 77-88 89 

and and 
Below , Above 

Self-Report Levels 
Full Model Predicted Val ue5--Vocational 

_ Full Model Predicted Val ues— Academic 

Predicted Values Assuming no Interaction 

Probability .1146 



ERIC 
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TABLE 4.16 

TEST FOR INTERACTION--VOCATIONAL"-TEACH'='RS AND 
SPECIAL EDUCATION TEACHERS 



30 



Self 
Minus 
Observa- 
tion 



20 



.10 




j- 



J. 



76 
and 
Below 



77-88 



89 
and 
Above 



Self-Report Levels 
Full Model Predicted Val ues— Vocational 

Full Model Predicted Values— Special Education 
Predicted Values Assuming no Interaction 



Probability .4648 
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TEST FOR INTERACTION--SPSCIAL EDUCATION TEACliSRS 
AND ACADEMIC TEACHERS 



Self 

Minus 20 ^ 
Observa- 
tion 



10 - 



Self-R-^port Levels 
Full Model Predicted Valuesr-Academic 

Full Model Predicted Values--Special Education 

Predicted Values Assuming noninteraction 

Probability .6973 




76 
and 
B^low 



77-88 



89 
and 
Above 
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TAELE 4.18 

TEST FOR INTERACTION'-IN-SERVICS 1 AND ' 2 
AND IN-SERVICE 3 



30 



Self 
Minus 
Observa- 
tion 



20 



10 




7; 



76 
and 
Below 

Self -Report Li -els 



89 
and 
Above 



Full Model Predicted Values — In-Service 1 & 2 



Full Model Predicted Values--In-Service 3 

Predicted Values Assuming no Interaction 

Probability -.0856 
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Self-Scores Minus 0^)served Scores Plotted ARaing;st 
Self -Scores . Self-scores miiius Observed scores plotted 
against t^elf-scores are displayed in the Appendix, These 
reproductions of computer plotting all plot s elf - reported 
scores on the vertical axis and the absolute differe . ;e 
between self-reports and or - erv at ion scores on the hori- 
::ontal axis. 

Tests for Lin . arity , Of the tests for Linearity 
which are presented in Tabler 4,19 through 4,24^ one con- 
cludes that linearity did not exist for the total sample 
(Table 4.19), for acadernic teachers (Table 4.?2), for in- 
service 1-2 (Table 4.23), or for in-^service 3 (Table 4.24). 
The low probability of linearity of scores for vocational 
teachr.rs (.0616) shown in Table 4.20' failed to substantiate 
a conclusion of linearity. The .7228 probability of li- 
nearity for special education teachers displayed in Table 
4.21 indicates a need for further investigation into the 
possibility of linearity. In each of these tables, 4.19 
through 4.24, observed scores are pxotted on the vertical 
axis vjhile self-reported scores are plotted on the hori- 
zontal axis. 

Comparison of F-Tests for Subgroups . This study 
dealt with comparing teacher self-reports of indi viduali 2.at ion 

/ 
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TEST FOR LINEARITY--TOTAL. SAMPLE 



Observed 




75 / 1 



Self-Reported 



1 



Probability of Linearity 0.0 



Predicted Values Full Model 



Predicted Values Restricted Model 



37 



TABL?" 4 , 20 



T2ST FOR LINEARITr--VDCATIONAL TEACHERS 



Observed 



125 
100 

75 r 

50 

25 



Probability of Linearity .0616 



50 75 100 125 / 
Self-Reported 

- Predicted Values Full Model 

Predicted Values Restricted Model 
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TABLE 4.21 

TEST FOR LINEARITY--SPECIAL EDUCATION TEACHERS 



Observed 



125 

100 

75 

50 I- 
25 



Probability' of Linearity .7228 



50 75 100 125 
Self-Reported 

— Predicted Values Full Model 



Predicted values Restricted Model 
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Observed 



125 
100 
75 
50 
25 



TABLE 4.22 



TrlST FOR LINEARITY- -ACADEMIC TEACHERS 





50 



Probability of Linearity G.O 



75 100 125 
Self-Reported 

Predicted Values Full Model 



_ . Predicted Values Restricted Model 
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TABLE 4.23 
TEST FOR LINEARITY — IN- SERVICE 1 AND 2 



Observed 



125 
100 
75 

50 
25 



Probability of Linearity .0000 




50 75 100 125 
Self -Reported 

Predicted Values Full Model 

— Predicted Values Restricted Model 



\ 
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TABLE 4.24 



TEST FOR LINEARITY--IN-SERVICE 3 



125 



100 



Observed 



75 



50 



is — rTJa~itr 

Self-Reported 



Probability of Linearity 0.0 




Predicted Values Full Model 



Predicted Values Restricted Model 



100 
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of instruction with reports of trained observers. In his 
study^ Heeney (1973) reported results of F-Tests based on 
observer reports. Table 4.25 summarizes the F^Tes_t^„px^- — 
ability for twelve tests^ displaying the F-Test probabil- 
ity calculated from all scores^ from self-reports only^ 
and from observer reports. F-Tests, between vocational 
and academic teachers, are significant at the ..01 level 
for all reports^ se if -reports ^ and observer reports, F- 
Tests between academic teachers who had in-service and aca- 
demic teachers with no in-service was significant atthe 
.01 level for all reports and s elf -reports y-^ut was 
slightly more than .05 for observer reports. The F-Test 
between districts 15 and 16 and districts 11^ 1?^ 13, 14, 
17, I8j 19, and 20 was significant at the .01 level for 
self -reports . Districts 15-16 offered no in--service in 
individualizing instruction ani teachers completed self- 
reports prior to observation. In the other districts , 
(11, 12, 13, 14, 17, 18, 19, and 20), where teachers com- 
pleted self -reports, after classroom observations were made, 
scores were consistently higher than in districts 15 and 
16. As also indicated in Table 4.32, F-Tests based on 
observer reports were significant below the .0^ level for 
comparisons between special education teachers and academic 
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miE 4-25 

COmiSONS OP P-TESTS ?0H SUBGROUPS BY ALL EEPORTS, SELF-REPORTS, MD OBSERVER REPORTS 



F-Test Probability 



Description 


All 

Reports 


Self- 
Reports 


Observer 
Reports 


iesi oeween vocaiioniL ieacners too u^q. in-servicc ^nietnou 
1 and 2 combined) and in-service 3 (no in-service) 


.3459 


.1897 


.4345 


Test between Special Education Teachers who had in-service 
(1 and 2). and in-senri;e 3 (no in-service) 


.7559 ■' 


.3787 


.2005 


Test between Academic Teachers who had in-service (l and 2) 
and in-serivce 3 (no in-service) 


.0070 


.0046 


.0512 


Test between Vocational a:id Special Education Teachers 


^.2434 


.i056 


r" aa*i 

.5901 


Test between Vocational Teachers and Academic Teachers 


.0003 


.,0062 


.0012 


Test between Special Education Teachers and Academic Teachers 


.0867 


.5655 


.0412 


Test between in-service 1 and in-service 2 


.9051 


.1468 


.3914 


Tjst be'tween in-service (l and 2 combined) and' in-senice 3 
(no in-service) 


.0271 


.0902 


.0519 


Test between in-service 1 and in-service 3 (no in-senice) 


.0956 


.6537 


.0359 


Test between in-service 2 and in-service 3 


.0529 


.0317 


.2262 


Test between 'districts 1 and 5 and districts 2, .5^ 4, 6, 7^ 
8, 9, and 10 


.6964 


.0569 ■ 


.2061 


Test between districts 15^ 16 and^ districts 11, 12, 13, 14/ 
17, 18; 19 and 20 ' 


. .0757 


.0044 


.4182 



l ERlC 
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teachers: and also l)e tveen in- service 1 (laboratory ap- 
proach) and in-service 3 (no in-service) based on self- 
reports* Pooling all reports yielded a significant dif- 
ference, below •05 J for teachers in districts which had 
offered any type of in-service for individualizing instruc- 
tion compared with teachers in districts where such in- 
service had riot been offered. 

Based on the information contained in Table 4 . 25 , 
one cannot conclude that use of either self-reports ex- 
clusively or observer reports exc lu s ive ly . would surface 
all significant relationships between variables tested. 

Summary of the Chapter 

Findings of the study were presented in this 
chapter. Following a review of the sample, the three 
studies, and mu.:.tipie linear regression, were presenta- 
tions of tests of each of the hypotheses* A summary of 
the findings and the implications for future research will 
be presented in Chapter V. 

/ 
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CHAPTER V. 
SUMMARY AND CONCLUSIONS 

This study sought to test three hypothese s con- 
cerning relationships betveeri self -reports of individuali- 
zation of instruction by a sample of 335 vocational, aca- 
demic, and special education teachers and reports completed 
by trained observers. The Individualization of Instruction 
Inventory (Harris and Mclntyre, 1971) vas the instrument 
employed in this study- Aspects of / individualization of 
instruction included in the instrument vere intraclass 
grouping, variety of materials, pupil autonomy, differen- 
tiated assignments, and tutoring- 

The three hypotheses tested by this study vere: 

1- Teachers* self-reports of individualization of in- 
struction practices on the Individualization of In- 
struction Inventory vill yield higher scores than ob- 
servations made using the same instrument- 

2- Discrepancies betveen scores derived from teachers' 
self-reports of individualization of instruction 
practices on the Individualization of Instruction 

95 



105 



96 

Inventory and scores from observations made using the 
same instrurcent vill increase as the degree of. in- 
dividualization of instruct! on, reflected from ob- 
servations, decreases. 
3. Scores derived from teachers^ se If --report s of indi- 
vidualization of instruction practice s vill vary in 
a systematic -way from scores derived from observations 
made using the same instrument, so as to permit de- 

velopraent of a set of factors for converting self- 

\ 

reports of individualization of instruction obtained 
from teacher self-reports into scores which would be 
reasonsable predictors of /scores recorded by trained 
obs' rver s . ^ 

The sample of 335 teachers consisted of 86 vo- 
cational, 200 academic, and 49 special education teachers 
located in 20 school districts within 100 miles of Austin, 
Texas. One hundred sixty-nine teachers were from 10 dis- 
tricts which had offered programs of in-service aimed 

. ..... \ 

toward helping teachers to improve practices of individu- 

alization of ins t r uc t'i on . The remaining 166 teachers were 

from districts where individualization of instruction had 

not been a prime topic during in-service sessions . 

Teachers from two districts in each set completed the 
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self-report prior to being observed. Teachers from the 
remaining eight districts in each set completed self- 
reports after being observed. Observations vere com- 
pleted during the spring of 1973 by a team of trained 
observers from the Office of School Surveys and Studies 
of The University of Texas at Austin as part of a project 
funded by the Division of Occupational Research and De- 
velopment of the Texas Education Agency. Interobserver 
reliability vas reported to have been .82 (Heeney, 1973). 
Data gathered by observers were also used in a study to 
test the effect of in-service education on teacher per-- 
f ormanee . Heeney (1975) reported that in-servict train- 
ing improved teacher performance as evidenced oy reports 

by trained observer.-; using the Individualization of In- 

\ 

atruction Inventory. All data used in these studies vere 
made available for use in a third study, still in the 
conceptual stages at the time of this vriting. 

Data vere analyzed using multiple linear re- 
gression analysis (Ward and Jennings, 1973) by means of 
the computer program LINEAR (Jennings, 197l) on file at 
the University of Texas Computation Center. 

The major findings of the study were as fol- 
lows: 

\ 

\ ■ . 

\ • • • 
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There vas a general tendency for scores of teachers' 
self-reports of individualization of instruction 
practices on the Individualization of Instruction In- 
ventory to be significantly higher than observations 
made uising the same instrument. 

There was a significant difference between self- 
reports of teachers whose observed behaviors were be- 
low ,the mean .and self-reports of teachers whose ob- 
served behaviors were above the mean . 
Discrepancies be.tween scores derived from teachers* 
self-reports of individualization of instruction 
practices on the Individualization of Instruction In- - 
ventory and scores from observations made using the 
same instrument increased as the degree of individu- 
alization of instruction, reflected from observations, 
decreased - 

Total scores derived from teachers' self-reports of 
individualization of instruction practices varied in 
a systematic way from scores derived from observa- 
tions made using the same instrument. A set of factors 
was developed for converting self -reports of individ- 
ualization of instruction obtained from teachers' 
self-reports into scores which would be reasonable 
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predictors of scores recorded by trained observer s . 
These factor-s are shown in Table 5-1. Th*-^ 

nejss of these factors vas tested by gene 

I 

random sample of 49 teachers from the 335 i ^ac 
s t^dy . Tventy-f our of the 49 fell into the same high, 
medium, or low levell of individualization on actual 
observer -reported scores as on predicted observation 
scores. In 12 cases, predicted, levels of individuali- 
zation oif instruction were higher than observed levels 
while in 13 cases observed levels were higher than 
predicted levels. This ind ic at e s that conversion 
factors are useful for actuarial statistics , ''riot for 
individual statistics- For example, knowledge that 

one teacher had a self -reported score on the Indi.yid- 

\ , , ■ • 

ualization of Instruction. Inventory: of 67 while anothe 

teachers^ self-reported score was 97 would not be 

sufficient to make judgments concerning, practices of 

individualization by thetwo teachers- On the other 

hand, if the mean self -reported score for teachers in 

Region A was 67, and 97 for teachers in Region B, then 

- t^O"'*dWc'lU*ig"l'"On'S"^'^^^ ^-j--y''-^-ga--c*KFf s'^*'!'^^^^ 



Region B practice ind ividualiz^ation of. 
a greater extent than teachers in "Regie 



instruction to 
n*A, and (2) 
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TABLE 5^1 

/' . 

FACTOBS FOR ESTIMATING OBSERVED SCORES FROM 

/ ■ ■ ■ 

/ SELF-REPORTS ON THE UTOIVIDULIZATION 

/ 

OF INSTRUCTION INVENTORY 



Descriptor 



Range of Self- 
Reports 



Factors to Subtract 
from Self -Reported 
Score to Predict 
Observation Score 



Self -reported scores 
more than one-heQ-f 
standard deviation 
^below the mean 

Self-reported scores 
between one -half 
standard deviation 
below mean and one- 
half- standard devi- 
ation above mean 

Self-reported scares 
more than one-half 
standard deviation 
'^-KboTe'^the-'mean''*- 



Scores 76-below 



Scores 77-88 



Scores 89-above 



22 



(Difference ^ 5) 
27 



(Difference = 5') 
32 
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there is a greater need. for in-service education in 
individualizing instruction in Region A than in Region 
B. Let us carr;y^ the example a step further. If 
teachers in Region A vere involved in in-service edu- 
cation on the basis of assessed n -subsequently 
the self-report form of the Indi ation of In- 

struction Inventory administer ed , higher self -reported 
posttest scores might indicate improved teacher prac- 
tices but also could be associated 'vith greater sophis 
tication in understanding terminology employed in the 
instrument. 

5. Factors for predicting observed levels of individuali- 
zation of instruction from self -reported scores met 
tests of statistical significance , for the sample 
population. While factors for pr ed ic t ing ob^'er ved 
levels of individ.ualization of instruction from self- 
reported scores of subgroups did not meet the test of 
staltistical significance, probabilities were too high 
to be rejected statistically. 

6. In districts vhere individualization of instruction 
Haa^^'iroT^'^e^en-^'a 

observation preceded self -report ing, teachers had / 
significantly higher self -reported scores, on the 
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Individualization of Instruction Inventory than teachers 
from the same set of districts in vhich observation 
followed self -reporting , In districts where teachers 
had experienced in-service education in individualiza- 
tion of instruction^ the differe^^^e between self- 
repo - of teachers wh -If-reports prior 

to observation when compared to. teachers who completed 
self-reports after being observed was not significant. 
Teachers who are individualizing instruction tend to 
krfow that ^they are doing soj on the other hand, 
teachers who are not individualizing ins truction do 
not seem to know whether or not they are. When self- 
reporting fol].ows observation, the self-report is 
tied to a specific class session; therefore, it would 
appear to be somewhat --e atening . A self-report 
which precedes observat~-- -n and is not tied to a spe- 
cific session may elicit middle -of -the -road "some- 
times I do and some'times I d on ' t -r e spons e s One 
implication of this is tha^ researchers, when asking / 
for information which ma- call for a s e If -ind ictrnen t, \ 
*'''sh"aurd~""use as "'nontlire ?li3Ing~1ieTHo'ds^^^^ V '" 

Another passrble Impii:::^- ion is that ' in-service edu- ; 
cation aimed at ina iv^om-liz at ion of instruction / 
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helped teachers to have perceptions of their ov;n per- 
formances -which were affected less by vhether obser- 
vation or self -reporting came first, thereby reducing 
differences in self-reported scores. 

Limitati ons 

This study vas subject to the usual constraints 
vhich confront researchers in the ir , attempt s to. publish 
findings . of significant impact on the educational com- 
munity--namely , time, resource?, ^nd .-o^raph; 

Factors developed fc st-^irsting observed scores 
from self -reports . on the Ind ivlr. ua?. iz - 1 ion of Instruction 
Inventory appl^ied only to the s;u~ ^ population Involved 
in this particular study. 

Practical consideratlaris llrrited this study to 
one observation and one self-r OJrt -t-r teacher. Thus, 
reasonable caution should be ex. :rci c in drawing , con- 
clusions and generalizations i' -ror. :he data. 

.. ..Gjsja.e.r.jal.. gone lesions Within th e. — 

Limitations of the Study 

Previous research (Harris Goody, 1967; 

Murray, 1971; and Heeney, 1973) nas s.emon/s tr a ued that 
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trained observers are able to describe teacher practices 
of five aspects of vhat is called individualization of in-- 
struction through use of the Individualization of Instruc- 
tion Inventory (Harris and Mclntyre, 1971). 

This study has presented evidence that self- 
report^ perceptions of individualization of "instruction 
by a sample population vhich included vocational, academic, 
and spe^cial education teachers^ using the Teacher Ques- 
tionnair^f orm of the Individualization of Instruction 
Inventory, ^bear sufficient relationships to scores recorded 
by trained observers who used the individuao-ization of In- 
struction Inventory so as to permit describing teacher ^ 
practices of these five aspects of ind ividualizat io.n of 
instruction as being high, medilim, or lov . Dividing 
points fell one-half standard deviation- below the mean 
and one-half standard deviation above the mean for self- 
reported perceptions on the Teacher Questionnaire of the 
Individualization of Instruction Inventory. These dividing 
points, as shovn in Table 5-1,^. set the limits of the three 
groups as being high--scores 89 and above; medium--scores 
77-88; 'and low--scores 76 and below. /Subtracting 32, 27, 
and' 22, respectively, from the mean rjfeach group yielded 
reasonable estimates of the means of observer-recorded 
s c or e s . - 
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Teachers ' self -reported scores o: the Individu* 
alization of Instruction Inventory generally were higher 
than observer reported scores. Teachers who were observed 
to he individualizing instruction more tended to have more 

realistic perceptions of their practices than* do teachers 

I 

who were observed to he individualizing instruction less -X 
A serendipitous observation of this researcher was that 
of the teachers visited, those who were from districts 
which had offered in-service education in individualiza- 
tion of instruction seemed mare enthusiastic as evidenced 
by invitations to view materials and student work, .as well 
as positive comments concerning the teaching-learning en-- 
vironment in vhich they oper etted . 

Implications for Future Research 

^- . . ■ 

Four categories of suggestions for further study 

are offered. First, future rese,archers might consider 

replicating the study using another sample population. ^ ' 

Such a study would help to determine if,; in fact, gen.erali 

z at ions_ couj^d^^^^^^ X?o^.,i!3^..X^^^^5?^.3..^^^ "^i^Al^^™^"^! 

Secondly, Se c t ion 16 . 310 of the Texas Education 

Code provides that teachers in Texas/ public schools ex- 
perience 10 days of in-Tervice education and preparation 
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for the beginning and ending of schools. Educational de- 
cision makers perceive individualization of instruction 

as a priority area for in-service training (Nutt, 1973). 

i 

A rational and cost --ejf f ective vay to determine the general 

• i 

need for individualization of instruction in-service 
teactier ura.:.ciing by a population of teachers would be a 
needs as se s sment study in which the Teacher Questionnaire 
of the Individualization of Ins truct ion In'/entory would be 
adminlsterec -go a sample of teachers in th- geographic 
are a of c one e-rn . 

Thirdly, teaching involves a complex set of 
activities. Heeney (1973) has suggested ^aat in-service 
experiences may affect observed teacher practices of in- 
dividualization of instruction • Further research is 
needed to describe other factors which may affect teacher 
practices of individualization of instruction. Among 
the factors which investigators may wish to consider are • 
tbacher attitudes^ demographic fl^ctors, leadership styles 
of\ building p:rincipals^ and availability of resources. 



Ini^ormation from such studies would help to provide educa- 

tXon al^a e c^i s'r6F''&^^ w 11:11 aro^iife^' oT'-^tTT'e^ 

be a^ssociatec with teacher behavior. / / 

\^ Finally, studies are recommended which concern 

teacher-pupi^ inter action- -what student differences may 
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be associated with differences in teacher practices o}: 
individualization of instruction? 
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THE UNTVERSITir OF TEXAS AT AUSTIN 

College of Eclucatlon 
AUSTIN, T8XA8 7871a 

Office of School Surveys February 1973 Area Code 512 471-7551 

Education Annex 



TO THE SUPERINTENDENT ADDRESSED: 



The Office of School Surveys at the University of Texas is under con-- 
tract to the Texas Education Agency to perform a study of in-service 
education. The purpose of this study is to determine if in-service 
education has had an effect upon the practices of vocational, special 
education, and academic teachers' performance in the classroom.^ The 
focus of the study will be on the individualization of instruction. 

\ - . . ' .- . 

Collection of data will be' by an observation visit to a sample of 
'classrooms and a self-report by the same sample of teachers. Teachers 
will be asked to voluntarily participate in the study by letter. 

We are asking for your help. Ten districts who have had in--service 
education in individualization of instruction and ten .distri9ts who 
have not had in-service education in individualization of instruction 
.will be selected to participate in the study. Please complete the 
enclosed form and return it at your earliest convenience. 

If you hav^ any questions or if we can be of any assistance to you, 
please let us know. 

Sincerely , j 

William C. Heeney / 
Project Director ' j ' 

Carl Ashbaugh, Ph.D. . . 

Director 

Office of School Surveys and Studies 
WCH : CA : ers 

Enclosure , 
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IN-SERVICE EDUCATION QUESTIONNAIRE 



1. Has your school district conducted an in-service education program 
of at least four clock hours in the individualization of instruc- 
tion since July 1970? 

Yes 



No 

2. Would you be willing for your school district to* participate in 
this study of in-service education? 

Yes 



No . _ 

3. If yes, who can serve as your district's contact person for this 
study? 

Name - - 

Title ^ ^ 



\ 

District ^ 

.-Signature \ , . 



Please return to: Mr. William C. Heeney ^ 

, -Orfice^*f^SH^b^6r"^Sttt?V'gy^ ^"^ — 

Education Annex 

The University of Texas at Austin 
* Austin, Texas 78712 
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THE UNIVERSITY OF TEXAS AT AUSTIN 

College of Education 
AU8TXK, TEXAS 7^7^^ 

Office of School Surveys February 26, 1973 Area Code 512 471-7551 

Education Annex 



TO THE PRINCIPAL ADDRESSED: 



The Office of School Surveys and Studies, at the University of Texas 
is under contract to the Texas Education Agency to perform a study of 
in-service education. The purpose of this study^ is to determine if . 
in-service education has had' an effect upon the practices of voca- 
tional, special education, and academic teachers* performance in the 
classroom. 

Your superintendent has agreed for your district to participate in 
this ^tudy of in-service education. 

Collection of data will be by an observation visit to. a sample of 
classrooms and a self -report by the same sample of teachers. Attached 
for your information is a copy of the letter which is being sent to 
this sample of teachers on youi* campus. 



If you have any questions or if we can be of any assistance to you 
please let us know. 



Sincerely 5 



V/illiam C. Heeney 
Project Director 



Carl R. Ashbaugh , Ph . D. "^''^ 
Director 

Office of School Surveys and Studies 

WCH:CRA:cl 

Enclosure 
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THE UNIVERSITY OF TEXAS AT AUSTIN 

college of Education 
AUSTIN, TEXAS 78712 

Office of School..Sur.veys - February 25, 1973 ^^^^ 471-7551 

Education Annex 



TO THE TEACHER ADDRESSED: 



The Office of School Siirveys and Studies at The University of Texas 
is under contract to the Texas Education Agency to perfom a study 
of in-service education. The purpose of this study is to determine 
if in-service education has had an effect upon the practices of voca- 
tional, special education,; and academic teachers* performance in the 
classroom. - 

The superintendent of schools in your district has given us permis- 
sion to include your district in this study of in-service education. 

We need your help. We would like to make an observation visit to your 
classroom at a mutually agreed upon time. This visit will^be for at 
least thirty minute^ and not longer than one hour. In addition to 
the one classroom observation we will need you to complete a self- 
report form the first week in May. 

Please complete and return the enclosed form at your earliest conven- 
ience. 

If you have any questions or if we can be of any assistance to you, 
please let us know. ; 

Sincerely, 



William C. Heeney 
Project Director 



Carl R. Ashbaugh, Ph.D. 
Director 

Office of School Surveys and Studies 

WCH:CRA:cl 

Enclosure 
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OBSERVATION QUESTIONNAIRE 

1. Are you- willing to participate in this study of in-service educa- 
tion? 

Yes ' 

No ■ 

2. If yes, as a prelitninary part of working out a schedule of obser- 
vations please list four days and hours in March and April con- 
venient to you for this observation to take place. 



March " April 
day hour day hour 

1. 1. ' ' 

2. 2. ' 

3. 3. ^ 



You will receive notice before this observation is made in your class- 
room . 

School \ : 

District ' ; 



Name 



Please return to: Mr. William C. Heeney \ 

Office of School Surveys 
Education Annex 

The University of Texas at Austin 
Austin, Texas 78712 
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THE UNIVERSITY OF TEXAS AT AUSTIN 

COLLEGE OF EDUCATION 
AtimN, TEXAS 787Xa 



Area Code 512 471-7551 



April 13, 1973 



Office of School Surveys 
Education Annex 



TO THE TEACHER ADDRESSED: 



There are twenty- five items on this inventory. Circle only one num-^ 
ter on each item that most, appropriately describes your classroom. 
Your name and date should appear at the top of the form. 

Please complete and retuiTa within five days from the date that you 
receive this inventory. 

The members of the research team wish to express their appreciation 
to you for taking part in this project. We wish you a very pleasant 
summer. 

Sincerely, 



William C. ^ Heeney 
Project Director 

WCH : dh 
Enclosures 
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THE UNIVERSITY Or TEXAS AT AUSTIN 



College : ' zi >n 

Ire c f : . .001 Su: -^s > ay ' i97'- Area :a2 47 -7551 



To the Teacher addressed: 

Recently you participated in the first. part of a study of individu- 
alization of instruction. 

Your participation in the second part of this study is needed. Please 
complete and return the Individualization of Instruction Inventory^ 
right now while you are thinking about it. It contains 25 items, is 
in a yellow cover and was mailed ro you in a large envelope. 

The members of the research team wish to thank you for participating 
in this study. Have a happy suimner. 

Thank you for completing and returning the inventory while it is fresh 
on your mind. 

Sincerely, 



William C. Heeney 

P.S. If you have already mailed this self- report , accept our thanks. 
WCH:cl 
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SPECIAL EDUCATION SELF MINUS OBSERVED SCORES FLOTTHD AO.Alr'S? SEi: SCOr£S 
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ACADEMIC SaF MINUS 0B3ERVATI ; SCORES PLOTTED AGAINST SELF SCORES 
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SErVlCE 1 and 2 SELF MINUS OESEF.VED SCORES PLOTTED AGAINST SELF SCOPES 
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